Associate Data Architect I- Azure/Snowflake & AWS Migration

UST
₹9,06,023 - ₹11,47,227 एक वर्ष
केरल
3 दिन पहले
    9 - 12 Years
    1 Opening
    Trivandrum


Role description

Tech Lead – Azure/Snowflake & AWS Migration

Key Responsibilities

  • Design and develop scalable data pipelines using Snowflake as the primary data platform, integrating with tools like Azure Data Factory, Synapse Analytics, and AWS services.
  • Build robust, efficient SQL and Python-based data transformations for cleansing, enrichment, and integration of large-scale datasets.
  • Lead migration initiatives from AWS-based data platforms to a Snowflake-centered architecture, including:

o Rebuilding AWS Glue pipelines in Azure Data Factory or using Snowflake-native ELT approaches.

o Migrating EMR Spark jobs to Snowflake SQL or Python-based pipelines.

o Migrating Redshift workloads to Snowflake with schema conversion and performance optimization.

o Transitioning S3-based data lakes (Hudi, Hive) to Snowflake external tables via ADLS Gen2 or Azure Blob Storage.

o Redirecting Kinesis/MSK streaming data to Azure Event Hubs, followed by ingestion into Snowflake using Streams & Tasks or Snowpipe.

  • Support database migrations from AWS RDS (Aurora PostgreSQL, MySQL, Oracle) to Snowflake, focusing on schema translation, compatibility handling, and data movement at scale.
  • Design modern Snowflake lakehouse-style architectures that incorporate raw, staging, and curated zones, with support for time travel, cloning, zero-copy restore, and data sharing.
  • Integrate Azure Functions or Logic Apps with Snowflake for orchestration and trigger-based automation.
  • Implement security best practices, including Azure Key Vault integration and Snowflake role-based access control, data masking, and network policies.
  • Optimize Snowflake performance and costs using clustering, multi-cluster warehouses, materialized views, and result caching.
  • Support CI/CD processes for Snowflake pipelines using Git, Azure DevOps or GitHub Actions, and SQL code versioning.
  • Maintain well-documented data engineering workflows, architecture diagrams, and technical documentation to support collaboration and long-term platform maintainability.

Required Qualifications

  • 9+ years of data engineering experience, with 3+ years on Microsoft Azure stack and hands-on Snowflake expertise.
  • Proficiency in:

o Python for scripting and ETL orchestration

o SQL for complex data transformation and performance tuning in Snowflake

o Azure Data Factory and Synapse Analytics (SQL Pools)

  • Experience in migrating workloads from AWS to Azure/Snowflake, including services such as Glue, EMR, Redshift, Lambda, Kinesis, S3, and MSK.
  • Strong understanding of cloud architecture and hybrid data environments across AWS and Azure.
  • Hands-on experience with database migration, schema conversion, and tuning in PostgreSQL, MySQL, and Oracle RDS.
  • Familiarity with Azure Event Hubs, Logic Apps, and Key Vault.
  • Working knowledge of CI/CD, version control (Git), and DevOps principles applied to data engineering workloads.

Preferred Qualifications

  • Extensive experience with Snowflake Streams, Tasks, Snowpipe, external tables, and data sharing.
  • Exposure to MSK-to-Event Hubs migration and streaming data integration into Snowflake.
  • Familiarity with Terraform or ARM templates for Infrastructure-as-Code (IaC) in Azure environments.
  • Certification such as SnowPro Core, Azure Data Engineer Associate, or equivalent.

Skills

Azure,AWS REDSHIFT,Athena,Azure Data Lake


About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
आवेदन करें
अन्य नौकरी सुझाव:

Azure Migration Lead

Bosch Group
Bengaluru, कर्नाटक
  • Lead Lift & Shift and clean deployment migrations...
  • Conduct application intake, discovery, and dependency...
3 दिन पहले

Customer Support Associate

MoSahay Associate
तमिलनाडु
₹9,452 - ₹11,317 एक माह
  • Graduates or Undergraduates
  • Language: Tamil & English
  • Typing Speed: 25 WPM with 85% Accuracy...
1 सप्ताह पहले

Architect

TD Engineering and Consulting Private Limited
तमिलनाडु
₹50,000 - ₹1,00,000 एक माह
  • Create architectural designs and detailed drawings.
  • Coordinate with clients, engineers, and contractors...
2 सप्ताह पहले

Junior Architect

Design n Architecture Studio
तमिलनाडु
They create detailed plans for construction projects, present drawings and plans for approval, and ensure that the building...
1 सप्ताह पहले

Azure Trainer - Immediate

Nithminds Private limited
Remote
₹3,000 - ₹3,500 एक दिन
  • Education & Experience:
  • Bachelor's degree in Computer Science, Information...
21 घंटे पहले

Enterprise Architect

merican Inc
कर्नाटक
₹15,99,248 - ₹20,25,004 एक वर्ष
As an Enterprise Architect, you will define strategy, guide cross-functional teams, and lead architectural initiatives that enable...
21 घंटे पहले

Microsoft .Net Azure Cloud Architect

TESTQ TECHNOLOGIES LTD
कर्नाटक
₹12,24,560 - ₹15,50,566 एक वर्ष
This section is used to describe what knowledge, skills and abilities are required to perform the daily tasks providing exemplary...
1 सप्ताह पहले