Indore, Madhya Pradesh, India
Qualification
Lead Software Engineer / Associate Architect with proficiency in design and implmentation of scalable and robust data engineering solutions
Skills Required
Bigdata, Pyspark , Python
Role
In-depth understanding of Big data concepts and distributed systems
Proficiency in Python and writing code in PySpark
Should possess good understanding of SQL concepts and must be proficient writing complex SQL queries
Thorough understanding of optimization and performance improvement for Spark based Workloads
Experience with working on atleast one Cloud platform will be a good to have
Conceptual knowledge and fitment for Data Structures & Algorithms
Possessing in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) & capable of providing design & architecture of typical business problems
Knowledge and experience with NoSQL Database (Cassandra/HBase/MongoDB/CouchDB/Neo4j),SQL Database (MySQL/Oracle).
Kafka, Redis, Distributed Message Queues alongwith Distributed Caching
Proficient understanding of Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration
Strong technical development experience with writing performant code leveraging best coding practices.
Good communication skills and aptitude
Experience
8 to 12 years
Job Reference Number
13248