Data Engineer

2 weeks ago

Chennai, Tamil Nadu, India Synechron Full time

Greetings,

We have an urgent opening for a Data Engineer specializing in PySpark at Synechron in Chennai. We are looking for candidates with more than 5+ years of relevant experience.

Position: Data Engineer-Pyspark

Location: Chennai

About Company:

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,700+, and has 58 offices in 21 countries within key global markets. For more information on the company, please visit our website or LinkedIn community.

Diversity, Equity, and Inclusion

Synechron's Diversity, Equity, and Inclusion (DEI) program, Same Difference, was developed because we believe in a culture of listening, respect, and opportunity.

We each bring unique backgrounds, thoughts, talents, and experiences with us to work every day, and we know that by embracing them, we are creating an even greater Synechron. The best way to build a strong team is to value individual differences. So, it doesn't matter where you're from or what you've had to do to get here – if you have the skills, enthusiasm, and drive to make your mark, we'll support you like we support each other. Choose a career with us and let's pursue innovation, together.

Job Description:

We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques.

The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven track record of implementing data engineering best practices. You will work closely with other data engineers to build solutions that drive impactful business insights.

Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.
  • Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.
  • Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.
  • Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.
  • Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.
  • Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.
  • Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes.
  • Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives.
  • Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations.

Qualifications:

Education and Experience:

  • Bachelor's or master's degree in computer science, Data Engineering, Information Systems, or a related field.
  • 3+ years of experience as a Data Engineer, with a strong focus on PySpark and the Cloudera Data Platform.

Technical Skills:

  • PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.
  • Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.
  • Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).
  • Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.
  • Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.
  • Scripting and Automation: Strong scripting skills in Linux.

Soft Skills:

  • Strong analytical and problem-solving skills.
  • Excellent verbal and written communication abilities.
  • Ability to work independently and collaboratively in a team environment.
  • Attention to detail and commitment to data quality.

If you are interested in this opportunity, kindly send your updated profile along with the required details listed below.

Total Experience: -

Experience in Data Engineer

Experience in Banking: -

Count of Projects Handled (Data Engineer, Pyspark, Cloudera Data Platform.) -

Current CTC:-

Expected CTC:-

Notice period:-

Current Location:-

Ready to relocate to Chennai: -

Visa Status:-

If you had gone through any interviews in Synechron before? If Yes when

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data engineer you will...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data Engineer Position: Data Engineer Experience: 2-4 years Location: Madipakkam, Chennai - work from office Skills & Requirements: Strong proficiency in Python with hands-on experience in Pandas and NumPy Expertise in PostgreSQL, including query optimization & performance analysis Solid understanding of statistical analysis and data...

  • Engineer (L1) - Titus Data Classification

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer Specialist

    3 days ago

    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We are Clustrex Data Private Limited, a company passionate about harnessing the power of data to drive business growth. As a Data Engineer, you will play a critical role in building and optimizing our data pipelines for efficient data processing.Job DescriptionYou will be responsible for designing and developing scalable data processing systems, ensuring...

  • 15h Left: Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data EngineerPosition: Data EngineerExperience: 2-4 yearsLocation: Madipakkam, Chennai - work from officeSkills & Requirements:Strong proficiency in Python with hands-on experience in Pandas and NumPyExpertise in PostgreSQL, including query optimization & performance analysisSolid understanding of statistical analysis and data transformation...

  • Senior Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Data Solutions Engineer

    21 hours ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Company Overview:We are Wavicle Data Solutions, a leading provider of data solutions. Our team is passionate about delivering innovative data-driven solutions that drive business growth.

  • TS Implementation Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Network Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Quality Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 311360NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Senior Quality Engineer Remote to join our team in Chennai Tamil Nxc4x81du IN-TN India IN Senior Quality Engineer...

  • Microsoft Security Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India IC Data Full time

    Security Engineer: ( Microsoft Subject Matter Expert) : Fulltime Remote About the Role:Do you want to be on the frontline fighting for safe use within the digital frontier? Does describing your job to your family and friends as being a cyberwarrior or threat hunter sound awesome or awe inspiring? Then join us as part of our Security Operations Center...

  • Senior Software Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world's choices. Our flagship platform,...

  • Senior Engineer-MS, Network

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Security Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Software Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world's choices. Our flagship platform, maya.ai,...

  • Senior Quality Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: 311361 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Quality Engineer (Remote) to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Senior...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Zemoso Technologies Full time

    Job Title: Data EngineerExperience: 3+ Years data pipelines experienceLocation: Chennai/MumbaiWork type: HybridJob Type: Full-timeKey Responsibilities:● Python Proficiency:Demonstrate a strong command of Python programming language, actively contributing to thedevelopment and maintenance of data engineering solutions.● Data Engineering Expertise:Set up...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India ZeMoSo Technologies Full time

    Job Title : Data Engineer. Experience : 3+ Years data pipelines experience. Location : Chennai. Work type : Hybrid. Job Type : Full-time. Key Responsibilities : Python Proficiency : - Demonstrate a strong command of Python programming language, actively contributing to the development and maintenance of data engineering solutions. Data Engineering Expertise...

  • Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India ZeMoSo Technologies Full time

    Job Title : Data Engineer. Experience : 3+ Years data pipelines experience. Location : Chennai. Work type : Hybrid. Job Type : Full-time. Key Responsibilities : Python Proficiency : - Demonstrate a strong command of Python programming language, actively contributing to the development and maintenance of data engineering solutions. Data Engineering Expertise...