Senior Data Engineer

1 week ago

bangalore, India Millaince Consultants Full time

                  Role- Data Engineer

  Exp – 6yrs – 8yrs

  Location- All GL Location

  • Extensive hands-on experience implementing data migration and data processing using AWS services: S3 Data Lake, AWS Glue, Lambda Functions, Athena, RDS Aurora, Databricks.
  • Good understanding of Data Governance, Data Security, Data Compliance, Data Quality, Metadata Management, Master Data Management, Data Catalog.
  • Strong experience with data modeling and schema design.
  • Strong SQL programming background.
  • At least 6+years of consulting or client service delivery experience on AWS.
  • At least 6+years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
  • Well versed in DevSecOps and CI/CD deployments.
  • Cloud migration methodologies and processes including tools like AWS Glue, Data Migration Service, Attunity (Qlik), Event Hub, Kafka, etc.
  • Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage.
  • Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.
  • Well versed in SQL Server and SSIS.
  • Good to have Node JS, Python, .Net.
  • Excellent interpersonal and teamwork skills.
  • Good knowledge of Agile Scrum.
  • Good communication skills.
  • Experience implementing data integration patterns that support a Data Fabric architecture, such as API-based access and data virtualization.
  • Hands-on experience with tools for metadata management and data lineage that enable a Data Fabric (e.g., Collibra, Informatica, Alation).
  • Ability to build data pipelines that feed into a distributed data environment, ensuring data is discoverable and accessible to data consumers via the fabric.

Required Skills & Qualifications

  • For Lead Data Engineer -> 8 to 10 years of experience in a Data Engineering role.
  • For Data Engineer -> 6-8 years of experience in a Data Engineering role.
  • Proven expertise with Microsoft Azure data services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) Gen2, and Azure Synapse or Databricks.
  • Strong proficiency in Apache Spark (PySpark/Scala) and SQL, Data Fabric
  • Experience with real-time data ingestion using services like Azure Event Hubs or Kafka.
  • Familiarity with building CI/CD pipelines and using version control systems (Git).

Preferred/Good-to-Have

  • Experience with schema registry and data governance tools like Azure Purview.
  • Knowledge of microservices and event-driven architecture patterns.
  • Experience with Infrastructure as Code (IaC) using Terraform or Bicep.

  • Senior Engineer, Data Engineering

    1 week ago

    Bangalore, India CoreTek Labs Full time

    We’re Hiring for Top MNC –Senior Data Engineer! Experience: 4 - 9 Years Notice Period: immediate to October joiners Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Python, Pandas, SQL, Snowflake, Git Spark, Airflow, ML models.

  • Data Senior Engineer

    2 weeks ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience in a...

  • Senior data engineer

    1 week ago

    Bangalore, India CoreTek Labs Full time

    ???? We’re Hiring for Top MNC –Senior Data Engineer! ???????? Location: PAN India ???? Experience: 4 - 9 Years Notice Period: immediate to October joiners ???? What we’re looking for: Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Must to have skills Python, Pandas, SQL, Snowflake,...

  • Senior data engineer

    1 week ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based...

  • Senior Engineer, Data Engineering

    1 week ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions to support our business intelligence and...

  • Senior Data Engineer

    1 week ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and...

  • Senior Data Engineer

    1 week ago

    bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...

  • Senior Data Engineer

    1 week ago

    Bangalore, India CoreTek Labs Full time

    We’re Hiring for Top MNC –Senior Data Engineer! Location: PAN India Experience: 4 - 9 Years Notice Period: immediate to October joiners What we’re looking for: Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Must to have skills Python, Pandas, SQL, Snowflake,...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 324638NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Key Responsibilities Design and implement...

  • Senior Data Engineer

    3 days ago

    Bangalore, India 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-time About the Role We’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure...