About OnebyZero
OnebyZero is a dynamic and fast-growing Singapore Headquartered; APAC based specialist Data & AI consulting company. We provide cutting-edge solutions that help businesses transform and thrive in the digital age. Our services blend deep industry expertise, strategy, technology, and data-driven insights to deliver business outcomes. We utilise data, artificial intelligence, and machine learning to unlock new opportunities and drive growth. Our mission is to empower businesses with innovative Data and AI solutions, fostering transformative growth and sustainable success.
We are looking for a Senior Data Engineer who can lead the design and development of large-scale data systems on AWS. This role requires someone with strong technical leadership, hands-on experience with modern data architectures, and a proven track record of delivering enterprise-grade data solutions.
Key Responsibilities
- Architect and implement end-to-end data pipelines using AWS cloud-native services.
- Design data lake, lakehouse, and warehouse architectures optimized for performance, scalability, and cost.
- Lead technical design reviews, code reviews, and solution walkthroughs with internal and client teams.
- Collaborate with stakeholders including data scientists, analysts, product owners, and enterprise architects to define data needs.
- Drive best practices in data engineering including testing, versioning, logging, and CI/CD for data pipelines.
- Implement security, data quality, and governance frameworks across data environments.
- Troubleshoot and optimize data workflows in production systems.
- Mentor and guide junior engineers on design, implementation, and delivery standards.
Requirements
Qualifications
- 8 years of experience in data engineering or a similar field.
- Expertise in building batch and real-time data pipelines using AWS services:
- S3, Glue, EMR, Redshift, Athena, Lambda, Dynamo DB, Kinesis, Step Functions, Lake Formation, CloudFormation, Airflow, CodeBuild, IAM Roles
- Strong programming skills in Python and SQL; working knowledge of PySpark or Scala.
- Deep understanding of data modeling, partitioning, and performance tuning.
- Active AWS Certification (e.g., AWS Certified Data Engineer or Solutions Architect – Associate/Professional).
- Strong understanding of data privacy, security, and compliance requirements.
- Experience with orchestration tools (e.g., Airflow, Step Functions) and CI/CD automation.
Preferred Skills
- Familiarity with Delta Lake, Iceberg, or Apache Hudi.
- Experience with IaC tools such as Terraform or CloudFormation.
- Exposure to multi-cloud or hybrid data architectures (GCP, Azure optional).
- Worked in agile and client-facing consulting environments.
- Prior experience in BFSI or Telco domain preferred.
Benefits
What We Offer
- An opportunity to be part of an agile, highly proficient and experienced AI/ML team
- An opportunity to work on challenging data science and machine learning problems with customers and seeing your work deployed in action
- A fast-paced software development environment that uses the latest open-source tools across the development stack
Benefits
We provide a competitive salary and benefits package, a vibrant work environment, and numerous opportunities for professional growth. You'll have the opportunity to work with a team of industry experts on exciting projects that transform businesses and create significant value. Join us to revolutionize the way companies leverage technology for digital transformation.
