DATA ENGINEER

3 days ago

India Xorstack Full time
About Us:

We are a dynamic and innovative company dedicated to delivering scalable and reliable data solutions for healthcare and ad-targeting industries. We thrive on harnessing the power of cloud-native technologies and advanced analytics to drive impactful business outcomes. Join our team to work on cutting-edge projects that leverage AI, big data, and cloud infrastructure.Role Overview:

We are looking for an experienced Data Engineer with a strong background in building and optimizing large-scale data pipelines within AWS cloud environments. This role requires expertise in ETL/ELT automation, Spark, Redshift, Glue, and orchestration tools like Airflow and Jenkins. The ideal candidate will be passionate about designing scalable data infrastructure, ensuring data quality, and improving pipeline performance.

Responsibilities:
  • Design, build, and maintain ETL/ELT pipelines using AWS Glue, Apache Spark, and PySpark for large-scale data processing.
  • Optimize data ingestion workflows from AWS S3 to Redshift and RDS to improve efficiency and reduce costs.
  • Develop data warehouses with fact and dimension tables tailored for analytical needs.
  • Automate and orchestrate data pipelines using Airflow and Jenkins for CI/CD integration.
  • Implement infrastructure as code using Terraform and automate deployments with Docker.
  • Lead end-to-end migration of data projects across AWS accounts ensuring zero data loss.
  • Monitor pipeline health and system uptime using Prometheus, Grafana, and AWS CloudWatch.
  • Collaborate with cross-functional teams to build analytics-ready datasets.
  • Innovate by leveraging AI-powered solutions like OpenAI API and Hugging Face models for query automation and unstructured data analysis.
Required Skills:
  • Minimum 3-6 years of experience as a Data Engineer with a strong focus on AWS services.
  • Proficiency in Python, SQL, Shell scripting, PySpark, and Apache Spark.
  • Hands-on experience with AWS Glue, Redshift, RDS, Lambda, S3, IAM, and other cloud services.
  • Familiarity with orchestration tools such as Apache Airflow and CI/CD pipelines with Jenkins or GitHub Actions.
  • Strong understanding of infrastructure provisioning using Terraform and containerization using Docker.
  • Experience implementing monitoring, logging, and alerting using Prometheus, Grafana, and Cloud Watch.
  • Knowledge of data modeling concepts including star and snowflake schemas.
  • Exposure to AI/ML model integration is a plus.
Qualifications:
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and team collaboration abilities.

  • Lead Data Engineer

    5 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    5 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    4 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    4 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Data Engineer

    1 week ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: ....

  • Data Engineer

    5 days ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). - 6+ years of experience in Data...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL (BODS) to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: . Migrate ETL...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT DATA North America Full time

    Job Description Req ID: 340517 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). - Hands-on experience in...

  • Senior Associate Data Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive. Your day at NTT...