Pyspark Engineer
1 month ago
Responsibilities:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Experience in data engineering or data analyst.
- Should have experience in ETL pipeline development.
- Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.
- Good experience in SQL/ Advanced SQL.
- Strong understanding of PySpark framework and its ecosystem, including DataFrame API, Spark SQL, RDDs, and MLlib.
- Experience in migrating to PySpark or similar data processing frameworks is highly desirable.
- Solid understanding of distributed computing principles, parallel processing, and scalability considerations.
- Familiarity with big data technologies such as Apache Hadoop, Apache Hive, Apache Kafka, and Apache Spark.
Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
Required Skills:
- Experience in data engineering or data analyst.
- Should have experience in ETL pipeline development.
- Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.
- Good experience in SQL/ Advanced SQL.
- Strong understanding of PySpark framework and its ecosystem, including DataFrame API, Spark SQL, RDDs, and MLlib.
- Experience in migrating to PySpark or similar data processing frameworks is highly desirable.
- Solid understanding of distributed computing principles, parallel processing, and scalability considerations.
- Familiarity with big data technologies such as Apache Hadoop, Apache Hive, Apache Kafka, and Apache Spark.
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Capgemini Engineering Full timeJob Title: Pyspark EngineerAt Capgemini Engineering, we are seeking a highly skilled Pyspark Engineer to join our team. As a Pyspark Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using the PySpark framework.Responsibilities:Design and develop ETL pipelines using PySpark to extract, transform,...
-
Pyspark Engineer
1 month ago
Bengaluru, India Capgemini Engineering Full timeResponsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...
-
Pyspark Engineer
1 month ago
Bengaluru, India Capgemini Engineering Full timeResponsibilities: Bachelor's degree in Computer Science, Engineering, or related field. Experience in data engineering or data analyst. Should have experience in ETL pipeline development. Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming. Good experience in SQL/ Advanced SQL....
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeJob Title: Data Engineer - PySparkWe are seeking a highly skilled Data Engineer with expertise in PySpark to join our team at Tata Consultancy Services.Key Responsibilities:Design and develop scalable data processing pipelines using PySparkWork with large datasets and ensure data quality and integrityCollaborate with cross-functional teams to integrate data...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeJob Title: Data Engineer - PySparkWe are seeking a highly skilled Data Engineer with expertise in PySpark to join our team at Tata Consultancy Services.Key Responsibilities:Design and develop scalable data processing pipelines using PySparkWork with large datasets and ensure data quality and integrityCollaborate with cross-functional teams to integrate data...
-
Senior PySpark Engineer
5 days ago
Bengaluru, Karnataka, India Minutes to Seconds Pty Ltd Full timeAbout the JobAt Minutes to Seconds, we're on a mission to match talented individuals with the perfect job opportunities. Our goal is to provide a seamless fit between skills and roles, driving success for both our candidates and clients.We're currently seeking a skilled Senior PySpark Developer to join our dynamic team. As a key member of our team, you'll be...
-
PySpark Developer
3 weeks ago
Bengaluru, Karnataka, India Capgemini Engineering Full timeJob Title: Pyspark EngineerAt Capgemini Engineering, we are seeking a highly skilled Pyspark Engineer to join our team.Responsibilities:Design and develop large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to integrate data engineering solutions.Develop and maintain complex data processing applications using...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Retail Kloud9 Technologies India Private Limited Full timeJob Title: Senior Data Engineer - PySparkCompany: Retail Kloud9 Technologies India Private LimitedJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Retail Kloud9 Technologies India Private Limited. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeData Engineer (Pyspark Developer) Job DescriptionTata Consultancy Services is seeking a highly skilled Data Engineer with expertise in Pyspark to join our team.Key Responsibilities:Design and implement Big Data pipelines using PySparkDevelop data processing tasks using PySpark, including reading data from external sources, merging data, aggregating data,...
-
Data Engineer
2 months ago
Bengaluru, India ANRI Solutions HR Services Full timeJob Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...
-
Senior Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeWe are seeking a highly skilled Senior Data Engineer with expertise in PySpark to join our team at Tata Consultancy Services.Key Responsibilities:Design and develop large-scale data processing systems using PySparkCollaborate with cross-functional teams to integrate data pipelines and ensure data qualityDevelop and maintain data transformation scripts using...
-
PySpark Data Engineer
1 month ago
Bengaluru, India KPI Partners Full timeOver all 2-4 years of Data Engineering experiece.Must have PySpark, Python, Spark and SQL.Must have anyone cloud expereince (Azure / AWS).Good to have Databricks Pro Certification.Exceptional opportunity for individuals who are willing to work in Data & Analytics firm.
-
Pyspark Hadoop Developer
2 months ago
Bengaluru, India Tata Consultancy Services Full timeJob Title:PySpark Hadoop EngineerExperience- 5 to 8 yrsLocation: Pune, Bangalore, HYD, DelhiKey Skills/Knowledge:Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional)Experience required:Good Data background. Hadoop is the primary...
-
PySpark Hadoop Developer
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeJob Title:PySpark Hadoop EngineerExperience: 5 to 8 yearsLocation: Pune, Bangalore, Hyderabad, DelhiKey Skills/Knowledge:We are seeking a highly skilled professional with a strong background in data and experience in Hadoop and PySpark. The ideal candidate will have a minimum of 4 years of experience, with at least 2 years of experience in PySpark....
-
Senior Cloud Engineer
2 weeks ago
Bengaluru, Karnataka, India Epsilon Full timeAbout EpsilonEpsilon is a leading company in the digital marketing space, and we're looking for talented individuals to join our team. As a Senior Cloud Engineer (Pyspark), you will play a key role in developing and building products that help us stay ahead of the competition.Job DescriptionWe're seeking a highly skilled Cloud Engineer with experience in...
-
Pyspark Developer
2 months ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Design and implementation of Big Data pipelines using PySparkDesired Experience Range: 5 to 8 YearsJob Location: Bangalore / PuneMust Have:Mandatory: Primary skill: Pyspark.5+ years of experience in the design and implementation of Big Data pipelines using PySpark,...
-
Pyspark Developer
2 months ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Design and implementation of Big Data pipelines using PySparkDesired Experience Range: 5 to 8 YearsJob Location: Bangalore / PuneMust Have:Mandatory: Primary skill: Pyspark.5+ years of experience in the design and implementation of Big Data pipelines using PySpark,...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India SKYLARK HR SOLUTIONS Pvt Ltd Full timePosition : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...
-
Lead Software Engineer
3 weeks ago
Bengaluru, Karnataka, India Epsilon Full timeAbout EpsilonEpsilon is a leading provider of data-driven marketing solutions. Our team of innovative thinkers develops and builds products that help us connect with millions of customers. We're looking for talented individuals who can help us solve complex problems and exceed expectations.Job DescriptionWe're seeking a Senior or Lead/Principal Engineer to...
-
Senior PySpark Developer
7 days ago
Bengaluru, Karnataka, India Hiring House Technology Full timeAbout the RoleHiring House Technology is seeking a highly skilled PYSPARK DEVELOPER to join our team and contribute to the design and development of robust PySpark applications for large-scale data processing.Key Responsibilities• Design and implement efficient data ingestion, transformation, and storage processes.• Develop and optimize PySpark...