Senior Data Engineer

4 weeks ago


Chennai, India Trinity Technology solutions Full time

We're seeking a highly skilled and experienced Senior Data Engineer to join our team You will play a pivotal role in designing, developing, and deploying robust data pipelines and data warehouse solutions leveraging Google Cloud Platform (GCP).

You will leverage your expertise in big data technologies like Hadoop, Spark, and Airflow to build scalable and efficient data processing pipelines for large datasets.

Responsibilities :

- Design, develop, and implement data pipelines using GCP services (e., Dataflow, Cloud Functions).

- Architect and optimize data warehouse solutions using BigQuery to ensure efficient data storage and retrieval.

- Utilize big data technologies (Hadoop, Spark, Hive, Pig) to process, transform, and analyze large datasets.

- Write clean, maintainable, and well-documented code using Python and other relevant programming languages.

- Implement data quality checks and data validation processes to ensure data integrity.

- Manage and monitor data pipelines using Airflow and CI/CD tools (e., Jenkins, Screwdriver) for automation.

- Collaborate with data analysts and data scientists to understand data requirements and translate them into technical solutions.

- Leverage expertise in data formats like Avro, Parquet, and ORC for efficient data storage and processing.

- Stay up-to-date with the latest advancements in big data technologies and cloud computing platforms.

Technical Skills & Qualifications :

- 5+ years of experience in big data engineering or a related field.

- In-depth knowledge of Google Cloud Platform (GCP) services for data processing and storage (e., Dataflow, BigQuery, Cloud Storage).

- Expertise in big data technologies like Hadoop, Spark, Hive, Pig, and HQL for data processing and analysis.

- Strong proficiency in Python and experience with other scripting languages (e., Bash, Shell).

- Solid understanding of data warehousing concepts and data modeling techniques.

- Experience with CI/CD tools like Airflow, Jenkins, or Screwdriver for automation.

- Familiarity with data quality tools and techniques for data validation.

- Experience with data visualization tools (Looker, Tableau, Business Objects) is a plus.

- Strong understanding of Unix/Linux operating systems.

- Excellent problem-solving, analytical, and critical thinking skills.

- Effective communication and collaboration skills.

- Ability to work independently and as part of a cross-functional team

(ref:hirist.tech)

  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Senior Data Architect**Overview**We are seeking an experienced Senior Data Architect to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...

  • Senior bi engineer

    4 weeks ago


    Chennai, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS Quick Sight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing.Key Responsibilities:Develop and lead the...

  • Lead Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...


  • Chennai, Tamil Nadu, India RAIS USA Full time

    At RAIS USA, we are seeking a highly skilled Senior Data Engineer to join our team.The estimated annual salary for this position is $250,000 - $350,000 depending on location and experience.About the RoleWe are looking for an experienced Senior AWS Data Engineer with expertise in data engineering, cloud services, and DevOps practices. The ideal candidate will...


  • Chennai, Tamil Nadu, India Fedrus global Full time

    Job Title: Senior Data Engineering Leader">Overview:">Fedrus Global is seeking an experienced Senior Data Engineering Leader to design and implement scalable end-to-end data pipelines that integrate and model datasets from various sources. The successful candidate will be responsible for managing the technical scope and architecture of projects before,...

  • Senior Data Engineer

    7 months ago


    Chennai, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...


  • Chennai, Tamil Nadu, India Globalemployees Full time

    At Globalemployees, we are looking for a highly skilled Senior Data Engineer to join our team. The estimated annual salary for this role is $140,000 - $170,000 based on industry standards and the location.Job Description:We are seeking an experienced data engineer with a strong background in designing and implementing scalable data pipelines to extract,...


  • Chennai, Tamil Nadu, India Growel Softech Pvt. Ltd. Full time

    Job Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team at Growel Softech Pvt. Ltd. in Chennai. This role requires strong expertise in SQL Server programming, particularly in creation and optimization of stored procedures, triggers, and user-defined functions.The ideal candidate will have overall 8+ years of experience...

  • Senior Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Forbes Advisor Full time

    About the RoleForbes Advisor is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing, building, and maintaining large-scale data pipelines that support our business operations.Key Responsibilities:Design and implement complex data architectures using GCP and...


  • Chennai, India Spendflo Full time

    Overview: As a Senior Data Engineer, you will be responsible for building and maintaining the entire data infrastructure at Spendflo. This includes designing the data models, creating and optimizing ETL pipelines, and ensuring the scalability, reliability, and performance of our data systems. You will work closely with cross-functional teams to enable...

  • Senior Data Engineer

    5 months ago


    Chennai, India Ciklum Full time

    Description Ciklum  is looking for a Senior Data Engineer  to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and...

  • Senior data engineer

    2 weeks ago


    Chennai, India Spendflo Full time

    Overview:As a Senior Data Engineer, you will be responsible for building and maintaining the entire data infrastructure at Spendflo. This includes designing the data models, creating and optimizing ETL pipelines, and ensuring the scalability, reliability, and performance of our data systems. You will work closely with cross-functional teams to enable...


  • Chennai, Tamil Nadu, India InfoCentroid Software Solutions Pvt. Ltd Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at InfoCentroid Software Solutions Pvt. Ltd in Chennai. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python,...


  • Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Data Engineer

    2 weeks ago


    Chennai, India Spendflo Full time

    Overview:As a Senior Data Engineer, you will be responsible for building and maintaining the entire data infrastructure at Spendflo. This includes designing the data models, creating and optimizing ETL pipelines, and ensuring the scalability, reliability, and performance of our data systems. You will work closely with cross-functional teams to enable...

  • Senior Consultant

    7 months ago


    Chennai, India AstraZeneca Full time

    Job Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark, and...


  • Chennai, Tamil Nadu, India Mavinsys Full time

    Job Overview: Mavinsys is seeking a highly skilled Senior Big Data Engineer to join our team. This role will focus on designing and developing scalable data pipelines using Scala and Spark, implementing robust and efficient Spark applications for data processing, and developing RESTful APIs to provide access to processed data for various applications.


  • Chennai, Tamil Nadu, India Live Connections Full time

    **Job Description**Live Connections is a dynamic organization seeking an experienced Senior Data Engineer Leader to join our team. In this role, you will be responsible for designing, developing, and implementing data engineering solutions to drive business growth and improve operational efficiency.About the Role:Salary Range: $150,000 - $200,000 per annum,...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job OverviewData Engineers at Cynosure Corporate Solutions design and develop large-scale data processing systems that handle massive amounts of data from various sources. As a Senior Data Engineering Manager, you will lead the development of our company's data infrastructure, ensuring it is scalable, efficient, and secure.About the RoleWe are seeking an...