Senior Data Engineer
4 weeks ago
We're seeking a highly skilled and experienced Senior Data Engineer to join our team You will play a pivotal role in designing, developing, and deploying robust data pipelines and data warehouse solutions leveraging Google Cloud Platform (GCP).
You will leverage your expertise in big data technologies like Hadoop, Spark, and Airflow to build scalable and efficient data processing pipelines for large datasets.
Responsibilities :
- Design, develop, and implement data pipelines using GCP services (e., Dataflow, Cloud Functions).
- Architect and optimize data warehouse solutions using BigQuery to ensure efficient data storage and retrieval.
- Utilize big data technologies (Hadoop, Spark, Hive, Pig) to process, transform, and analyze large datasets.
- Write clean, maintainable, and well-documented code using Python and other relevant programming languages.
- Implement data quality checks and data validation processes to ensure data integrity.
- Manage and monitor data pipelines using Airflow and CI/CD tools (e., Jenkins, Screwdriver) for automation.
- Collaborate with data analysts and data scientists to understand data requirements and translate them into technical solutions.
- Leverage expertise in data formats like Avro, Parquet, and ORC for efficient data storage and processing.
- Stay up-to-date with the latest advancements in big data technologies and cloud computing platforms.
Technical Skills & Qualifications :
- 5+ years of experience in big data engineering or a related field.
- In-depth knowledge of Google Cloud Platform (GCP) services for data processing and storage (e., Dataflow, BigQuery, Cloud Storage).
- Expertise in big data technologies like Hadoop, Spark, Hive, Pig, and HQL for data processing and analysis.
- Strong proficiency in Python and experience with other scripting languages (e., Bash, Shell).
- Solid understanding of data warehousing concepts and data modeling techniques.
- Experience with CI/CD tools like Airflow, Jenkins, or Screwdriver for automation.
- Familiarity with data quality tools and techniques for data validation.
- Experience with data visualization tools (Looker, Tableau, Business Objects) is a plus.
- Strong understanding of Unix/Linux operating systems.
- Excellent problem-solving, analytical, and critical thinking skills.
- Effective communication and collaboration skills.
- Ability to work independently and as part of a cross-functional team
-
Senior Data Architect
5 days ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeJob Title: Senior Data Architect**Overview**We are seeking an experienced Senior Data Architect to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...
-
Senior Machine Learning Engineer
3 weeks ago
Chennai, Tamil Nadu, India Crayon Data Full timeWe are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...
-
Senior bi engineer
4 weeks ago
Chennai, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS Quick Sight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing.Key Responsibilities:Develop and lead the...
-
Lead Data Engineer
5 days ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeJob Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...
-
Senior Data Engineering Expert
5 days ago
Chennai, Tamil Nadu, India RAIS USA Full timeAt RAIS USA, we are seeking a highly skilled Senior Data Engineer to join our team.The estimated annual salary for this position is $250,000 - $350,000 depending on location and experience.About the RoleWe are looking for an experienced Senior AWS Data Engineer with expertise in data engineering, cloud services, and DevOps practices. The ideal candidate will...
-
Senior Data Engineering Leader
1 week ago
Chennai, Tamil Nadu, India Fedrus global Full timeJob Title: Senior Data Engineering Leader">Overview:">Fedrus Global is seeking an experienced Senior Data Engineering Leader to design and implement scalable end-to-end data pipelines that integrate and model datasets from various sources. The successful candidate will be responsible for managing the technical scope and architecture of projects before,...
-
Senior Data Engineer
7 months ago
Chennai, India Epam Full timeDescription EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...
-
Senior Data Engineer Specialist
2 weeks ago
Chennai, Tamil Nadu, India Globalemployees Full timeAt Globalemployees, we are looking for a highly skilled Senior Data Engineer to join our team. The estimated annual salary for this role is $140,000 - $170,000 based on industry standards and the location.Job Description:We are seeking an experienced data engineer with a strong background in designing and implementing scalable data pipelines to extract,...
-
Senior Data Engineer
1 week ago
Chennai, Tamil Nadu, India Growel Softech Pvt. Ltd. Full timeJob Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team at Growel Softech Pvt. Ltd. in Chennai. This role requires strong expertise in SQL Server programming, particularly in creation and optimization of stored procedures, triggers, and user-defined functions.The ideal candidate will have overall 8+ years of experience...
-
Senior Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India Forbes Advisor Full timeAbout the RoleForbes Advisor is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing, building, and maintaining large-scale data pipelines that support our business operations.Key Responsibilities:Design and implement complex data architectures using GCP and...
-
Senior data engineer
1 week ago
Chennai, India Spendflo Full timeOverview: As a Senior Data Engineer, you will be responsible for building and maintaining the entire data infrastructure at Spendflo. This includes designing the data models, creating and optimizing ETL pipelines, and ensuring the scalability, reliability, and performance of our data systems. You will work closely with cross-functional teams to enable...
-
Senior Data Engineer
5 months ago
Chennai, India Ciklum Full timeDescription Ciklum is looking for a Senior Data Engineer to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and...
-
Senior data engineer
2 weeks ago
Chennai, India Spendflo Full timeOverview:As a Senior Data Engineer, you will be responsible for building and maintaining the entire data infrastructure at Spendflo. This includes designing the data models, creating and optimizing ETL pipelines, and ensuring the scalability, reliability, and performance of our data systems. You will work closely with cross-functional teams to enable...
-
Senior Big Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India InfoCentroid Software Solutions Pvt. Ltd Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at InfoCentroid Software Solutions Pvt. Ltd in Chennai. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python,...
-
Engineer (L1) - Titus Data Classification
2 months ago
Chennai, India NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Senior Data Engineer
2 weeks ago
Chennai, India Spendflo Full timeOverview:As a Senior Data Engineer, you will be responsible for building and maintaining the entire data infrastructure at Spendflo. This includes designing the data models, creating and optimizing ETL pipelines, and ensuring the scalability, reliability, and performance of our data systems. You will work closely with cross-functional teams to enable...
-
Senior Consultant
7 months ago
Chennai, India AstraZeneca Full timeJob Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark, and...
-
Senior Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Mavinsys Full timeJob Overview: Mavinsys is seeking a highly skilled Senior Big Data Engineer to join our team. This role will focus on designing and developing scalable data pipelines using Scala and Spark, implementing robust and efficient Spark applications for data processing, and developing RESTful APIs to provide access to processed data for various applications.
-
Senior Data Engineer Leader
4 weeks ago
Chennai, Tamil Nadu, India Live Connections Full time**Job Description**Live Connections is a dynamic organization seeking an experienced Senior Data Engineer Leader to join our team. In this role, you will be responsible for designing, developing, and implementing data engineering solutions to drive business growth and improve operational efficiency.About the Role:Salary Range: $150,000 - $200,000 per annum,...
-
Senior Data Engineering Manager
1 week ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeJob OverviewData Engineers at Cynosure Corporate Solutions design and develop large-scale data processing systems that handle massive amounts of data from various sources. As a Senior Data Engineering Manager, you will lead the development of our company's data infrastructure, ensuring it is scalable, efficient, and secure.About the RoleWe are seeking an...