Senior Data Engineer
4 weeks ago
Job Description:
We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field.
The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations.
This role offers an exciting opportunity to work on cutting-edge projects, contribute to the design and architecture of applications, and collaborate closely with business users.
Key Responsibilities:
- Data Engineering: Hands-on experience in PySpark, including Dataframe core functions and Spark SQL, for data processing and analytics.
- SQL Databases: Proficiency in SQL databases to write queries of varying complexity for data retrieval and manipulation.
- Big Data Programming: Experience in Big Data programming for data transformation, aggregations, and analytics.
- Customer Communication: Excellent communication skills to interact effectively with customers and stakeholders.
- Analytical Skills: Strong analytical skills to understand complex data requirements and troubleshoot issues effectively.
- Design & Architecture: Contribute to the overall design and architecture of applications developed and deployed.
- Performance Tuning: Optimize application performance by tuning executor sizing, environmental parameters, code optimization, and partition tuning.
- Requirements Gathering: Interact with business users to understand their requirements and translate them into functional specifications.
- Project Implementation: Implement projects based on functional specifications, ensuring timely and accurate Bachelor's/Master's degree in Computer Science, Information Systems, or a related field.
- Minimum of 5+ years of experience in data engineering.
- Strong proficiency in PySpark, Python, Spark, and SQL.
- Experience with Big Data technologies and programming languages.
- Excellent communication and interpersonal skills.
- Strong analytical and problem-solving abilities.
Technical Skills & Competencies:
- Expertise in PySpark, Python, Spark, and SQL.
- Hands-on experience in Big Data programming and analytics.
- Ability to design and architect data solutions.
- Strong performance tuning skills.
- Excellent communication and collaboration skills.
- Detail-oriented with a focus on quality and accuracy.
-
Senior Machine Learning Engineer
3 weeks ago
Any Location, India K2 Data & Analytics Full timeJob Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...
-
Senior Machine Learning Engineer
4 weeks ago
Any Location, IN K2 Data & Analytics Full timeJob Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...
-
Senior Backend Engineer
3 weeks ago
Any Location, India K2 Data & Analytics Full timeJob Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed...
-
Senior Backend Engineer
3 weeks ago
Any Location, IN K2 Data & Analytics Full timeJob Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...
-
Senior Mechanical Engineer
2 weeks ago
bangalore, India Abha Engineer Full timeWe are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.
-
Senior Data Engineer
3 weeks ago
Bangalore/Any Location, India SWAI TECHNOLOGIES PRIVATE LIMITED Full timeJob Description : We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage. Experience with big data processing environments,...
-
Senior Data Engineer
4 weeks ago
Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...
-
Harmony Data Integration Technologies
6 days ago
Any Location/Bangalore, India Harmony Data Integration Technologies Pvt. Ltd. Full timeJob Description : We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...
-
Harmony Data Integration Technologies
7 days ago
Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full timeJob Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...
-
Senior Data Engineer
4 weeks ago
Bangalore/Any Location, IN Randstad Full timeJob Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...
-
Senior Data Engineer
22 hours ago
Chennai/Any Location, India mlesystems Full timeJob Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek...
-
Senior Data Engineer
1 day ago
Chennai/Any Location, IN mlesystems Full timeJob Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek a...
-
Senior Data Warehouse Engineer
2 weeks ago
Bangalore/Any Location, IN TalentXo Full timeCriteria :Role : Strong Senior Data Warehouse/Data Engineer - Must have more than 8+ YOE in Software Development- Must have 6+ YOE in Data Ware house/Data Engineering and Data Modelling- Must have strong work experience in Any Dataware House / Data Lake- Must have Good Experience in SQL on any databases MySQL / PostgreSQL / Postgres / Oracle / SQL Server /...
-
Senior Data Warehouse Engineer
2 weeks ago
Bangalore/Any Location, India TalentXo Full timeCriteria :Role : Strong Senior Data Warehouse/Data Engineer - Must have more than 8+ YOE in Software Development- Must have 6+ YOE in Data Ware house/Data Engineering and Data Modelling - Must have strong work experience in Any Dataware House / Data Lake- Must have Good Experience in SQL on any databases MySQL / PostgreSQL / Postgres / Oracle / SQL Server /...
-
Senior Data Engineer
4 weeks ago
Any Location, IN Muoro Full timeRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...
-
Senior Data Engineer
1 month ago
Any Location, India Muoro Full timeRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large (un)structured datasets, collaborating with analysts, data...
-
Lytx - Senior Manager - Data Engineering
21 hours ago
Any Location/Bangalore, India Lytx, Inc Full timeWhy Lytx :This role will have a positive impact on Data Engineering and delivery as well as team and employee development.If you enjoy helping teams reach their potential, working on interesting technical challenges and delivering products that save lives, this role may be a great fit for you! We are looking for someone who leads by example rather than...
-
Lytx - Senior Manager - Data Engineering
1 day ago
Any Location/Bangalore, IN Lytx, Inc Full timeWhy Lytx :This role will have a positive impact on Data Engineering and delivery as well as team and employee development.If you enjoy helping teams reach their potential, working on interesting technical challenges and delivering products that save lives, this role may be a great fit for you! We are looking for someone who leads by example rather than...
-
MLOps Developer
4 days ago
Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...
-
MLOps Developer
3 days ago
Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...