Data Engineer

Fulcrum Digital
महाराष्ट्र
पूर्णकालिक
10 घंटे पहले

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities:

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for: Technical Requirements:

Programming Languages: o Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

 Large-scale data processing: o Experience with PySpark or Big Data environments – 1–2+ years (preferred) o Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies: o Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience o Experience designing ETL workflows using native AWS services

Infrastructure and DevOps: o Terraform – 1–2 years of experience (Intermediate level) o Git – Daily use in collaborative development environments

Best Practices: o Well-structured project organization, error handling, logging, and automated testing within data pipelines Professional Profile:

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues  Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory):

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting) Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

AWS certifications are a plus

 



आवेदन करें
अन्य नौकरी सुझाव:

Site Reliability Engineer

Gold's Gym
तमिलनाडु
  • Engage in and improve the whole lifecycle of services—from...
  • Support services before they go live through activities such...
2 सप्ताह पहले

Software Engineer, Android

NatWest Group
Bengaluru, कर्नाटक
  • This is an opportunity for a driven Software Engineer to...
  • Day-to-day, you'll build a wide network of stakeholders of...
1 सप्ताह पहले

Mechanical Engineer - Piping stress

ASSYSTEM
Navi Mumbai, महाराष्ट्र
  • PIPESTRESS
  • RSTAB and/or BEAMSTRESS
  • CAESAR-II...
2 सप्ताह पहले

BIM Engineer

ASSYSTEM
Mumbai, महाराष्ट्र
Assystem Stup is a full-service design, engineering and project delivery consultancy created following Assystem’s acquisition of...
18 घंटे पहले

CDP ETL & Database Engineer

Zeta Global
तेलंगाना
  • ETL Development – The CDP ETL C Database Engineer will be...
  • Implementations s Onboarding – Will work with the team to...
3 सप्ताह पहले

Senior Backend Engineer

Tala
Remote
  • 5+ years of professional software development experience
  • Expertise in at least one of the following languages: Java,...
2 सप्ताह पहले

Senior Software Engineer - Backend

Freshworks
तेलंगाना
  • Build scalable backend services that handle millions of...
  • Own the full development lifecycle: from high-level design...
1 सप्ताह पहले

Manager - Product Support Engineer

Genpact
Bengaluru, कर्नाटक
Manage product launches, ensure communication of Key issues identified , LRK and Product issues to contact centres on high...
4 सप्ताह पहले

Sous Chef - Indian Cuisine

Accor
राजस्थान
₹3,30,557 - ₹4,18,559
  • Responsible for kitchen operations in absence of Executive...
  • Oversee the safety and sanitation of the kitchen, while...
23 घंटे पहले

Media Planner

Realiti.io
तमिलनाडु
  • Develop and execute comprehensive media plans based on...
  • Work closely with media vendors and publishers to negotiate...
23 घंटे पहले