Senior PySpark Engineer
2 weeks ago
Job Overview:
Greetings from our company. We are seeking a highly skilled Senior PySpark Engineer to join our team.
Key Responsibilities:
- Implement data ingestion pipelines from various data sources, including databases, S3, and files.
- Design and develop ETL/ Data Warehouse transformation processes using PySpark.
- Work with structured and unstructured data to build scalable and reusable data processing frameworks.
- Develop cloud-based enterprise solutions in PySpark and SparkSQL.
- Integrate end-to-end data pipelines to ensure quality and consistency of data.
- Perform performance analysis and optimization of data processing tasks.
- Apply best practices in design and analysis, automation, testing, monitoring, and documentation.
Requirements:
- 4-8 years of experience in working with big data technologies, particularly PySpark.
- Strong understanding of data processing concepts, data architecture, and cloud computing.
- Excellent programming skills in Python, with expertise in PySpark and related frameworks.
- Experience with data warehousing, data modeling, and ETL processes.
- Ability to work in a collaborative environment and communicate effectively with cross-functional teams.
What We Offer:
- A competitive salary and benefits package.
- Opportunities for career growth and professional development.
- A dynamic and innovative work environment.
- Collaborative teams and open communication channels.
-
Pyspark Engineer
1 day ago
Bengaluru, Karnataka, India Pan Asia HR Solutions Full timeJob Description : We are looking for a skilled PySpark Developer with expertise in ETL processes, Python, and SQL to design, develop, and optimize large-scale data processing pipelines. The ideal candidate will have hands-on experience in PySpark for data transformation, aggregation, and analysis in a Big Data environment.Key Responsibilities : - Design,...
-
Chief Pyspark Engineer
2 weeks ago
Bengaluru, Karnataka, India beBeeDataScientist Full timeJob Title: Pyspark DeveloperWe are seeking a skilled Pyspark Developer to join our team. The ideal candidate will have extensive experience in developing and fine-tuning programs and applications using Python, PySpark, and Scala on Big Data/Hadoop platforms.The successful candidate will work closely with our Risk Management team to implement risk models in...
-
PySpark Developer
4 weeks ago
Bengaluru, Karnataka, India ValueLabs Full timeJob Title- PySpark Data EngineerWe're growing our Data Engineering team at ValueLabs and looking for a talented individual to build scalable data pipelines on Cloudera Data PlatformExperience- 5years to 9years.Pyspark Job Description:• Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the...
-
PySpark Developer
4 weeks ago
Bengaluru, Karnataka, India ValueLabs Full timeJob Title- PySpark Data EngineerWe're growing our Data Engineering team at ValueLabs and looking for a talented individual to build scalable data pipelines on Cloudera Data PlatformExperience- 5years to 9years.Pyspark Job Description:• Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the...
-
Pyspark Developer
4 weeks ago
Bengaluru, Karnataka, India ValueLabs Full timePyspark DeveloperLocation - Bangalore (5 Days WFO)Experience Level - 5+ yrs Notice Period - Immediate to 15 daysJob Description:We are seeking a highly skilled Python & PySpark Developer to join our dynamic team. This position will be responsible for developing and maintaining complex data processing systems using Python and PySpark, ensuring high...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India beBeePyspark Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking an experienced PySpark Engineer to join our team. As a key member of our organization, you will be responsible for implementing data ingestion pipelines from various sources and developing scalable and reusable frameworks for data ingestion and processing.The ideal candidate will have strong experience in building ETL/data warehouse...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timePosition - Pyspark Developer Experience: 6 to 12 Years Notice Period- 0-60 Days Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Job Location: Chennai / Pune / Bangalore / Hyderabad / Gurugram Must Have: Data Engineer, Python developer with specialty in...
-
Pyspark Developer
3 weeks ago
Bengaluru, Karnataka, India ValueLabs Full timePyspark Developer Location - Bangalore(5 Days WFO) Experience Level - 5+ yrs Notice Period - immediate to 15 days Job Description: Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy. Data Ingestion: Implement and manage...
-
Pyspark Developer
3 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from TCS TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Chennai / Pune / Bangalore / Hyderabad / Trivandrum / Kochi Must Have: Data Engineer, Python...
-
Pyspark Developer
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from TCSTCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Chennai / Pune / Bangalore / Hyderabad / Trivandrum / KochiMust Have:Data Engineer, Python developer with...