Data Engineer

2 weeks ago

Chennai, India Visionyle Solutions Full time

Job Title : Data Engineer

Department : Data & Analytics Product Group, FCSD Tech

Location : Chennai

Experience : 8+ years

Position Overview :

The Data & Analytics Product Group under FCSD Tech is seeking a highly dynamic, motivated, and results-oriented Data Engineer to join our Parts Pricing product line. The ideal candidate will have extensive experience in SQL development, cloud technologies (preferably GCP), and a solid understanding of key data processing tools and frameworks. This role offers an exciting opportunity to work in a fast-paced and innovative environment, interfacing with multiple business and technology stakeholders. The position will also provide exposure to futuristic technology domains, including BigQuery, GCP native ETL services, CI/CD pipelines, and Cloud Scheduler tools.

Key Responsibilities :

- Design, implement, and optimize data solutions using GCP native services for batch and real-time data processing.

- Collaborate with cross-functional teams (engineering, product, business) to deliver scalable and high-performance data pipelines.

- Leverage BigQuery, DataFlow, DataProc, DataFusion, Cloud Build, and Airflow for data engineering tasks.

- Develop and maintain CI/CD pipelines to streamline the deployment of data solutions.

- Support the migration of legacy ETL systems to cloud-native solutions.

- Integrate various data sources such as Oracle, Teradata, DB2, BigQuery, and flat files.

- Monitor and optimize the performance of data processing pipelines.

- Provide technical expertise and guidance in the analysis, design, development, and implementation of data warehousing applications.

- Debug and troubleshoot ETL jobs and resolve performance issues in parallel processing jobs.

Skills and Qualifications :

Required :

- 5+ years of experience in complex SQL development.

- 2+ years of experience with Google Cloud Platform (GCP), specifically in designing and implementing solutions at a production scale.

- Strong understanding of key GCP services, particularly related to data processing (Batch/Real-Time), leveraging Terraform, BigQuery, BQSQL, Dataflow, DataFusion, DataProc, Cloud Build, Airflow, and Pub/Sub.

- Hands-on experience with ETL tools, such as IBM Datastage, DataFlow, or similar data processing tools.

- Experience in integrating various data sources such as Oracle, Teradata, DB2, BigQuery, and flat files into a central data warehouse.

Preferred :

- Experience in designing ETL jobs using stages like Look-up, Filter, Sort, Copy, Remove Duplicates, Join, Funnel, and Aggregator.

- Proven experience in debugging ETL jobs and resolving errors and warnings associated with each job run.

- Expertise in tuning ETL jobs to optimize performance and resolving issues related to parallel jobs.

- Experience working with Autosys or Astronomer, Accurev, and Github for job scheduling and version control.

Education and Experience :

- 8+ years of experience in data engineering, with a strong background in building and maintaining data pipelines.

- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).

Why Join Us :


- Opportunity to work with cutting-edge technologies in a fast-paced, dynamic environment.

- Be part of a collaborative and innovative team that values continuous learning and development.

- Exposure to cloud-native technologies and the chance to work with Google Cloud Platform tools at scale.

(ref:hirist.tech)

  • Data Engineer

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Chief Data Science Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...

  • Cybersecurity Engineer for NTT DATA

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Engineer (L1) - Titus Data Classification

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Artificial Intelligence Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Are you a seasoned AI expert looking to make a significant impact at a leading global innovator in business and technology services?We are seeking a highly skilled Artificial Intelligence Engineer to join our team at NTT DATA. This role offers the opportunity to design, develop, and test software systems, modules, or applications for software enhancements...

  • Crayon Data | Senior Software Engineer | chennai

    3 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Crayon Data | Senior Software Engineer | chennai

    3 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Crayon Data | Senior Software Engineer | chennai

    3 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Senior Machine Learning Engineer

    3 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...

  • Bastion Data Solutions | Cloud SRE Architect

    4 days ago

    Chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    4 days ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    5 days ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 days ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...