Python, Pyspark Data Engineer
2 days ago
Responsibilities
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platform’s services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
· Experience building and optimizing data pipelines in a distributed environment
. Data Modelling and Design Experience of atleast 5 years
· Experience supporting and working with cross-functional teams
· Proficiency working in Linux environment
. 8+ years of advanced working knowledge of SQL, Python, and PySpark
· 8+ years of experience with using a broad range of AWS technologies Mandatory
· Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
· Experience with platform monitoring and alerts tools
-
Pyspark/Python Data Engineer
4 months ago
Delhi, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Python +pyspark
6 months ago
Delhi, India Nityo Infotech Full time2 hours ago **Job Code**: JD-19623 **JOB DESCRIPTION**: Mandatory Skills - Python, Pyspark, DataBricks, SQL Primary Skills: - Hands-on Python, PySpark, Databricks, SQL, AWS (S3, Lambda, EC2, RDS), and CI-CD tools. Job description: - 6 or more years of experience developing, testing, and implementing major Information Technology programs or projects that...
-
Python, Pyspark Data Engineer
1 day ago
Delhi, India KC Executive Search Full timeTechnical Stack: Python, Spark, AWS, PySparkResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...
-
AWS Data Engineer
4 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Delhi, India KC Executive Search Full timeTechnical Stack: Python, Spark, AWS, PySparkResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...
-
delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
1 week ago
Delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Engineer
2 days ago
Delhi, India Tata Consultancy Services Full timeJob DescriptionName of the position: Data engineerLocation : Bangalore, Hyderabad,Mumbai, Pune ,Chennai,NCRSkill Requirements & Experience- Overall 8+ years of work experience in Data Warehouse(DWH) Development- Experience in Azure, Python , SQL , Pyspark- Hands on exp in Azure data factory, data bricks- Exposure and experience to Cosmos- Understanding of...
-
Delhi, India KC Executive Search Full timeTechnical Stack: Python, Spark, AWS, PySparkResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...
-
PySpark Developer
1 day ago
Delhi, India Tata Consultancy Services Full timeRole : PySpark Developer Technical Skill Set : PySpark, Python, HDFS, Hadoop, SQLLocation : Mumbai, Pune ,Chennai, Banglore , NCR, HyderabadMust-Have :Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured dataAbility to design data pipelines in end to end mannerKnowledge on Avro, Parquet...
-
Aws data engineer
2 weeks ago
Delhi, India Recro Full timeJob Title: Data EngineerExperience : 5+ yearsLocation : RemoteJob Type : Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...
-
AWS Data Engineer
1 week ago
Delhi, India Recro Full timeJob Title: Data Engineer Experience : 5+ yearsLocation : RemoteJob Type : Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...
-
AWS Data Engineer
2 weeks ago
Delhi, India Recro Full timeJob Title: Data EngineerExperience : 5+ yearsLocation : RemoteJob Type : Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...
-
Senior Data Engineer
2 weeks ago
Delhi, India Recro Full timeKey skills: Python - 4+ years/Azure - 1 years/Pyspark - 4+ years/Github/DB - SQL any SQLLocation - Bengaluru & KochiDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The...
-
Data Engineer
3 weeks ago
delhi, India Luxoft Full timeProject Description: As a Data Engineer you'll be working alongside data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and...
-
Pyspark Developer
1 week ago
Delhi, India Tata Consultancy Services Full timeGreetings from Tcs !!!We are conducting interviews for Pyspark Developer .Role: Pyspark DeveloperExperience: 6-10 YearsLocation: BangaloreResponsibility of / Expectations from the Role- Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations- Minimum 3 years of Python development experience- Minimum 2 years of...
-
Pyspark Developer
1 week ago
Delhi, India Tata Consultancy Services Full timeGreetings from Tcs !!!We are conducting interviews for Pyspark Developer .Role: Pyspark DeveloperExperience: 6-10 YearsLocation:BangaloreResponsibility of / Expectations from the RoleMinimum 5 years of PySpark Development experience, especially in Spark SQL and Complex TransformationsMinimum 3 years of Python development experienceMinimum 2 years of...
-
Senior Data Engineer
2 weeks ago
Delhi, India Recro Full timeKey skills:Python - 4+ years/Azure - 1 years/Pyspark - 4+ years/Github/DB - SQL any SQLLocation - Bengaluru & KochiDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The...