DATA ENGINEER

6 days ago

Bengaluru, Karnataka, India Xorstack Full time ₹ 15,00,000 - ₹ 25,00,000 per year

About Us:

We are a dynamic and innovative company dedicated to delivering scalable and reliable data solutions for healthcare and ad-targeting industries. We thrive on harnessing the power of cloud-native technologies and advanced analytics to drive impactful business outcomes. Join our team to work on cutting-edge projects that leverage AI, big data, and cloud infrastructure.

Role Overview:

We are looking for an experienced Data Engineer with a strong background in building and optimizing large-scale data pipelines within AWS cloud environments. This role requires expertise in ETL/ELT automation, Spark, Redshift, Glue, and orchestration tools like Airflow and Jenkins. The ideal candidate will be passionate about designing scalable data infrastructure, ensuring data quality, and improving pipeline performance.

Responsibilities:

  • Design, build, and maintain ETL/ELT pipelines using AWS Glue, Apache Spark, and PySpark for large-scale data processing.
  • Optimize data ingestion workflows from AWS S3 to Redshift and RDS to improve efficiency and reduce costs.
  • Develop data warehouses with fact and dimension tables tailored for analytical needs.
  • Automate and orchestrate data pipelines using Airflow and Jenkins for CI/CD integration.
  • Implement infrastructure as code using Terraform and automate deployments with Docker.
  • Lead end-to-end migration of data projects across AWS accounts ensuring zero data loss.
  • Monitor pipeline health and system uptime using Prometheus, Grafana, and AWS CloudWatch.
  • Collaborate with cross-functional teams to build analytics-ready datasets.
  • Innovate by leveraging AI-powered solutions like OpenAI API and Hugging Face models for query automation and unstructured data analysis.

Required Skills:

  • Minimum 3-6 years of experience as a Data Engineer with a strong focus on AWS services.
  • Proficiency in Python, SQL, Shell scripting, PySpark, and Apache Spark.
  • Hands-on experience with AWS Glue, Redshift, RDS, Lambda, S3, IAM, and other cloud services.
  • Familiarity with orchestration tools such as Apache Airflow and CI/CD pipelines with Jenkins or GitHub Actions.
  • Strong understanding of infrastructure provisioning using Terraform and containerization using Docker.
  • Experience implementing monitoring, logging, and alerting using Prometheus, Grafana, and Cloud Watch.
  • Knowledge of data modeling concepts including star and snowflake schemas.
  • Exposure to AI/ML model integration is a plus.

Qualifications:

  • Strong problem-solving skills and attention to detail.
  • Excellent communication and team collaboration abilities.

  • Data Entry Operator

    6 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Sr. Data Engineer Data Science

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Technical Lead- Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Sr Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...