Data Engineer Specialist

3 days ago


Bengaluru, Karnataka, India Innovatily Full time
Job Description

About Us:

Innovatily is a leading data-driven company dedicated to transforming raw data into actionable insights. Our team leverages cutting-edge technologies like Apache Spark and AWS Glue to build robust, scalable data pipelines that meet our diverse data processing needs.

We are seeking highly skilled ETL Developers to join our team and contribute to the growth of our data infrastructure.

Key Responsibilities
  • Design, develop, and deploy efficient ETL pipelines using Apache Spark and AWS Glue.
  • Collaborate with data engineers and analysts to understand data requirements and translate them into optimized ETL processes.
  • Integrate data from various sources, including S3, relational databases, and APIs.
  • Implement data validation and error handling mechanisms to ensure data quality.
  • Monitor and troubleshoot ETL jobs to ensure data accuracy and pipeline reliability.
Requirements

To be successful in this role, you will need:

  • Experience in ETL development, with a focus on Apache Spark and AWS Glue (3+ years).
  • Strong expertise in Apache Spark (PySpark, Spark SQL) and AWS Glue.
  • Proficiency in programming languages such as Python or Scala.
  • Familiarity with orchestration tools like Apache Airflow.
  • Solid understanding of data warehousing concepts, data modeling, and ETL best practices.
Estimated Salary

$120,000 - $180,000 per year, depending on experience.

Benefits

We offer a competitive salary and benefits package, including:

  • Opportunity to work on challenging data projects with a talented team.
  • A culture of continuous learning and professional development.
  • Flexible working arrangements, including remote work options.


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • Cloud Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA is a global leader in IT services, with a strong presence in the data center industry. We are seeking an experienced Data Center Operations Specialist to join our team.About the RoleThe successful candidate will be responsible for the design, installation, and maintenance of complex mechanical, electrical, and infrastructure systems in...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...


  • Bengaluru, Karnataka, India CLOUD ANALOGY CRM SPECIALIST LIMITED Full time

    Job DescriptionWe are seeking a highly skilled Data Governance Specialist to join our team at Cloud Analogy CRM Specialist Limited. As a key member of our organization, you will play a crucial role in ensuring the quality and integrity of our data.Key Responsibilities:- Collaborate with global teams to develop, test, and deploy data quality solutions.-...


  • Bengaluru, Karnataka, India CLOUD ANALOGY CRM SPECIALIST LIMITED Full time

    Job Overview: CLOUD ANALOGY CRM SPECIALIST LIMITED seeks an experienced data developer to fill a key role in our organization. The ideal candidate will possess a strong background in data development, with expertise in Python and various cloud technologies. This position requires hands-on experience in building data pipelines and designing data management...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are currently seeking a highly skilled Data Protector Specialist to join our team at NTT DATA. The successful candidate will have a strong background in Data Protector and Storeonce, with experience in designing, implementing, and managing complex backup systems.Main ResponsibilitiesDesign and implement Data Protector and Storeonce solutions...


  • Bengaluru, Karnataka, India Quantiphi Full time

    QuantiphiJob Title: Data Engineering SpecialistOverview:We are seeking an experienced Data Engineering Specialist to join our team at Quantiphi. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data processing pipelines using Scala and Spark.Responsibilities include creating efficient data...


  • Bengaluru, Karnataka, India NR Consulting - India Full time

    About the RoleWe are seeking a highly skilled Data Engineering Specialist to join our team at NR Consulting - India. The ideal candidate will have experience in designing and building data pipelines, architecting data engineering pipelines on Snowflake, and leveraging Snowpark and UDFs for IoT streaming analytics.


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are currently seeking a highly skilled Data Integration Specialist to join our team in Bangalore, India.Job SummaryThe successful candidate will be responsible for designing and developing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Key ResponsibilitiesDevelop high and...


  • Bengaluru, Karnataka, India Impetus Full time

    We are seeking a highly skilled Data Engineering Specialist to join our team at Impetus.Estimated Salary: ₹20-35 lakhs per annum.Location: Gurgaon / BangaloreAbout the RoleThis is an exciting opportunity for a talented professional to design, develop, and deploy large-scale data systems using various technologies.Design and implement data pipelines, ETL...


  • Bengaluru, Karnataka, India Hevo Data Full time

    About the RoleWe are seeking an experienced Data Integration Solutions Specialist to join our team at Hevo Data. This is a challenging and rewarding role that requires a strong understanding of data integration solutions and excellent communication skills.Key ResponsibilitiesTo identify and qualify new business opportunities through targeted outreach and...


  • Bengaluru, Karnataka, India Sourcebae Full time

    Unlock a challenging opportunity as a Senior Data Engineering Specialist with Sourcebae. We are seeking an experienced professional to join our Data Science team in Bangalore, India.About the RoleWe are looking for a seasoned Data Engineer to play a critical role in enriching and maintaining our central repository of datasets. This is a contract onsite...

  • Data Engineer

    1 month ago


    Bengaluru, Karnataka, India Idyllic Services Full time

    Job Title: Data Engineer - ETL SpecialistAbout the Role:We are seeking a highly skilled Data Engineer - ETL Specialist to join our team at Idyllic Services. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Python and ETL tools.Key Responsibilities:Collaborate with stakeholders to...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the Role:We are seeking an experienced Enterprise Data Integration Specialist to join our team in Bangalore, India. As a key member of our organization, you will be responsible for installing, upgrading, configuring, optimizing, and administering the Informatica platform.Key Responsibilities:Install, upgrade, configure, optimize, and administer the...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:We are seeking a highly skilled Data Analyst/Validator to join our team in Bangalore, India. As a key member of our data analytics team, you will be responsible for extracting, transforming, and loading data from various sources to ensure data quality, integrity, and accuracy.Key Responsibilities:Perform data cleansing, validation, and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a skilled Data Centre Operations Specialist to join our team in Bangalore, India. This is a fantastic opportunity for individuals passionate about technology and data centre operations.About the RoleThe successful candidate will be responsible for maintaining the efficiency and reliability of our server infrastructure, ensuring...

  • ML Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA is seeking a skilled ML Engineer - Cloud Infrastructure Specialist to join our team.Estimated Salary: ₹1,200,000 - ₹2,400,000 per annumKey Responsibilities:Design and implement efficient CI/CD pipelines using Vertex AI Pipelines and Cloud Build for automating the entire ML lifecycle on GCP.Develop and manage infrastructure as code...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India EMB Global Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EMB Global. As an ETL specialist, you will be responsible for designing, developing, and maintaining efficient ETL processes for multi-scale data sets.This is a challenging role that requires expertise in data engineering, cloud-based data platforms, and big data technologies. If...