Data Engineer(Pyspark)
2 months ago
Skills : Python & Pyspark; Any Cloud Experience, preferably AWS. Strong Database / Datawarehouse Experience
Experience : 12-16 Years
Location : Mumbai / Pune / Chennai / Hyderabad / Bangalore / Kolkata / Delhi / Coimbatore
Job Description:
• Deep experience in developing data processing tasks using PySpark/spark such as reading data from external sources, merging data, performing data enrichment and loading into target data destinations.
• Develop, program, and maintain applications using the Apache Spark and python open-source framework
• Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming
• Spark Developer must have strong programming skills in Python , Java, or Scala
• Familiar with big data processing tools and techniques
• Good understanding of distributed systems
• Proven experience as a Spark Developer or a related role
• Excellent problem-solving and analytical thinking skill
• Experience with building APIs for provisioning data to downstream systems .
• Working experience on any Cloud technology like AWS ,Azure, Google is an added advantage
• Hands-on experience with AWS S3 Filesystem operations is an added advantage
-
Pyspark Engineer
3 weeks ago
bangalore, India Capgemini Engineering Full timeResponsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...
-
Pyspark Engineer
1 month ago
bangalore, India Capgemini Engineering Full timeResponsibilities: Bachelor's degree in Computer Science, Engineering, or related field. Experience in data engineering or data analyst. Should have experience in ETL pipeline development. Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming. Good experience in SQL/ Advanced...
-
Data Engineer
1 month ago
Bangalore/Hyderabad, Karnataka, India ANRI Solutions HR Services Full timeJob Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...
-
Senior Data Engineer
4 weeks ago
Bangalore, Karnataka, India SKYLARK HR SOLUTIONS Pvt Ltd Full timePosition : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...
-
PySpark Developer
2 weeks ago
Bangalore, India Rigel networks Full timeJob Title - Pyspark DeveloperLocation : Bangalore G.P.O., Karnataka Job Description :Lead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience...
-
PySpark Developer
1 month ago
Bangalore, Karnataka, India Rigel networks Full timeJob Title - Pyspark DeveloperLocation : Bangalore G.P.O., Karnataka Job Description :Lead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience...
-
Data Engineer(Pyspark)
2 months ago
bangalore, India LTIMindtree Full timeSkills: Python & Pyspark; Any Cloud Experience, preferably AWS. Strong Database / Datawarehouse ExperienceExperience: 12-16 YearsLocation: Mumbai / Pune / Chennai / Hyderabad / Bangalore / Kolkata / Delhi / Coimbatore Job Description:• Deep experience in developing data processing tasks using PySpark/spark such as reading data from external sources,...
-
Data Engineer
2 weeks ago
Bangalore/Chennai, India TekPillar Full timeJob Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, Python Job Description : We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience. - Strong experience with AWS services:...
-
Data Engineer
1 month ago
Bangalore/Chennai, Tamil Nadu, India TekPillar Full timeJob Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, PythonJob Description :We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience.- Strong experience with AWS services: Glue,...
-
PySpark Engineer
3 weeks ago
Pune/Bangalore/Chennai/Hyderabad, India nhrms Full timeJob Title: PySpark DeveloperJob Summary:We are seeking a highly skilled PySpark Developer to join our team at NHRMS. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using PySpark.Key Responsibilities:Develop and maintain efficient data processing workflows...
-
Data Engineer
1 month ago
Bangalore/Pune/Trivandrum/Thiruvananthapuram, IN Rao Career Solutions Full timeJob Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...
-
Data Engineer
4 weeks ago
Bangalore/Pune/Trivandrum/Thiruvananthapuram, India Rao Career Solutions Full timeJob Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...
-
Data Engineer(Pyspark)
1 month ago
Bangalore City, India LTIMindtree Full timeSkills: Python & Pyspark;Any Cloud Experience, preferably AWS. Strong Database / Datawarehouse ExperienceExperience: 12-16 YearsLocation: Mumbai / Pune / Chennai / Hyderabad / Bangalore / Kolkata / Delhi / Coimbatore Job Description:-Deep experience in developing data processing tasks using PySpark/spark such as reading data from external sources, merging...
-
Senior Data Engineer
3 weeks ago
Bangalore, India PureSoftware Pvt Ltd. Full timeJob Title: Senior Data Engineer - ETL/PySparkAt PureSoftware Pvt Ltd., we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and delivering data pipelines using ETL/PySpark.Key Responsibilities:Design and develop scalable data pipelines using ETL/PySpark and Azure...
-
Data Engineer
3 weeks ago
Bangalore, India PureSoftware Pvt Ltd. Full timeJob Title: PureSoftware - Data Engineer - PySpark/ETLJob Summary:We are seeking a highly skilled Data Engineer to join our team at PureSoftware Pvt Ltd. The successful candidate will be responsible for designing, developing, and delivering ADF pipelines across various integration points for the Accounting & Reporting Stream.Key Responsibilities:Design and...
-
AWS Data Engineer
2 weeks ago
Bangalore/Hyderabad, Karnataka, India AppSierra Solutions Pvt Ltd Full timeDescription :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...
-
Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Chennai/Pune/Noida TETRAHED INC Full timeRole : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Chennai/Pune/Noida, IN TETRAHED INC Full timeRole : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...
-
Senior Data Engineer
3 weeks ago
Bangalore, India PureSoftware Pvt Ltd. Full timeJob Title: Senior Data Engineer - ETL/PySpark SpecialistJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at PureSoftware Pvt Ltd. As a Senior Data Engineer, you will be responsible for designing, developing, and delivering complex data pipelines using Azure Databricks and Azure Data Factory.Key Responsibilities:Design and...
-
bangalore, India ConsultBae India Private limited Full timeData Engineer (Python PySpark Apache Airflow NoSQL) Location: Bengaluru Karnataka India (Onsite) Experience: 35 yearsResponsibilities: Build optimize and maintain scalable ETL pipelines for data ingestion and processing. Develop and manage workflows using Apache Airflow for scheduling and orchestrating tasks. Work with distributed computing technologies...