Senior Data Engineer
1 month ago
We’re seeking a Product Data Engineer with over 3 years of experience in data engineering, with strong skills in SQL/SQL Server, Linux, and ETL pipeline management. As part of our Product Technology team, you will play a key role in managing extensive datasets, optimizing workflows, and collaborating with cross-functional teams to ensure data-driven insights are actionable and aligned with company goals.
Responsibilities
· Cloud Infrastructure: Manage data on GCP (BigQuery, Cloud SQL, Compute Engine) for data warehousing, database management, and computational tasks.
· Data Storage Optimization: Enhance data storage and processing efficiency using GCP Cloud Storage and related cloud services.
· Database Management: Configure, maintain, and optimize SQL Server and Cloud SQL databases to ensure reliability and scalability.
· ETL Pipeline Development: Design and manage ETL pipelines using Linux cron jobs for scheduled tasks, ensuring efficient data extraction, transformation, and loading.
· Data Workflow Management: Oversee data processing workflows for accuracy, efficiency, and alignment with project goals.
· Team Collaboration: Collaborate with data engineers, analysts, and product teams to streamline data operations across departments.
· Automation & Processing: Automate data processing tasks across Linux and Windows environments for optimal performance.
· SQL Mastery: Write, debug, and optimize SQL queries for data extraction, transformation, and analysis in SQL Server and cloud databases.
· Python Scripting: Develop Python scripts for data analysis and task automation, using libraries like Pandas and NumPy.
· Monitoring & Alerts: Set up alerts and monitor key metrics to ensure data accuracy and system reliability.
· Google Analytics 4 Support: Provide support by leveraging GA4 to analyze customer behavior.
· Dashboarding: Build real-time reporting dashboards with Looker Studio, integrating with SQL databases for visualization and insights.
· Data Sampling & Validation: Conduct data sampling and validation manually in Excel for quality assurance.
Qualifications
· Educational Background: BTech/MTech in Computer Science, Data Science, or a related field.
· Experience: Over 3 years in data engineering, with proven ability to manage data processes and collaborate across teams.
· Technical Skills: Strong proficiency in Python and SQL; hands-on experience with SQL Server, Linux, and cron jobs for automation.
· Data Visualization: Experience using Looker Studio, Power BI, or other BI tools for dashboard creation.
Preferred
· D2C Experience: Experience in a Direct-to-Consumer (D2C) or e-commerce environment.
· Advanced Data Visualization: Familiarity with Looker Studio Pro for enhanced reporting capabilities.
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
2 weeks ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Expert for Analytics Projects
1 week ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
-
Cloud Data Engineering Lead
7 days ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
ITI Data | PySpark Data Engineer
14 hours ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
Lead data engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Senior Data Infrastructure Architect
3 days ago
India OSD Data Services Full timeAbout the RoleWe are seeking a highly skilled Senior Data Infrastructure Architect to join our team at OSD Data Services. This is an exciting opportunity to work with cutting-edge technologies and be part of a fast-growing company that's transforming how businesses leverage their data.
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Senior Data Engineer
1 month ago
India iO Associates - UKEU Full timeJob Title: Senior Data Engineer Location: Mohali Salary: up to 30 LPA iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...
-
Senior data engineer
4 weeks ago
India Synechron Full timeGood-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...
-
Aws data engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Data Platform Engineer
2 days ago
India OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
3 days ago
India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
1 month ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...