Senior Data Engineer

3 days ago

India Millaince Consultants Full time

Role- Data Engineer

Exp – 6yrs – 8yrs

Location- All GL Location

  • Extensive hands-on experience implementing data migration and data processing using AWS services: S3 Data Lake, AWS Glue, Lambda Functions, Athena, RDS Aurora, Databricks.
  • Good understanding of Data Governance, Data Security, Data Compliance, Data Quality, Metadata Management, Master Data Management, Data Catalog.
  • Strong experience with data modeling and schema design.
  • Strong SQL programming background.
  • At least 6+years of consulting or client service delivery experience on AWS.
  • At least 6+years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
  • Well versed in DevSecOps and CI/CD deployments.
  • Cloud migration methodologies and processes including tools like AWS Glue, Data Migration Service, Attunity (Qlik), Event Hub, Kafka, etc.
  • Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage.
  • Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.
  • Well versed in SQL Server and SSIS.
  • Good to have Node JS, Python, .Net.
  • Excellent interpersonal and teamwork skills.
  • Good knowledge of Agile Scrum.
  • Good communication skills.
  • Experience implementing data integration patterns that support a Data Fabric architecture, such as API-based access and data virtualization.
  • Hands-on experience with tools for metadata management and data lineage that enable a Data Fabric (e.g., Collibra, Informatica, Alation).
  • Ability to build data pipelines that feed into a distributed data environment, ensuring data is discoverable and accessible to data consumers via the fabric.

Required Skills & Qualifications

  • For Lead Data Engineer -> 8 to 10 years of experience in a Data Engineering role.
  • For Data Engineer -> 6-8 years of experience in a Data Engineering role.
  • Proven expertise with Microsoft Azure data services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) Gen2, and Azure Synapse or Databricks.
  • Strong proficiency in Apache Spark (PySpark/Scala) and SQL, Data Fabric
  • Experience with real-time data ingestion using services like Azure Event Hubs or Kafka.
  • Familiarity with building CI/CD pipelines and using version control systems (Git).

Preferred/Good-to-Have

  • Experience with schema registry and data governance tools like Azure Purview.
  • Knowledge of microservices and event-driven architecture patterns.
  • Experience with Infrastructure as Code (IaC) using Terraform or Bicep.

  • Senior data engineer

    4 days ago

    India Beige Bananas Full time

    Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that focuses on building hyper custom AI products for Fortune 500 Retail, CPG, and Media companies. The company embraces an outcome-driven mindset to help clients accelerate value realization from their analytics investments. Role Description This is a full-time remote...

  • Senior Associate Data Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive. Your day at NTT...

  • Senior Data Engineer

    5 days ago

    India Beige Bananas Full time

    Company DescriptionBeige Bananas is a rapidly growing pure play AI consulting firm that focuses on building hyper custom AI products for Fortune 500 Retail, CPG, and Media companies. The company embraces an outcome-driven mindset to help clients accelerate value realization from their analytics investments.Role DescriptionThis is a full-time remote role for...

  • Senior GenAI Engineers

    1 week ago

    Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 8+...

  • Senior GenAI Engineers

    1 week ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Location: | Experience: 8+...

  • Senior Azure Stack Engineer

    3 weeks ago

    Remote, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN).Job Title: Senior Azure Stack...

  • Senior Engineer, Data Engineering

    2 weeks ago

    India People Prime Worldwide Full time

    About Client: Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business...

  • Lead Data Engineer

    4 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    4 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    3 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...