Senior Python/PySpark Developer
5 days ago
About the Role :
We are seeking a highly skilled Senior Python/PySpark Developer to lead our data engineering and analytics initiatives. The ideal candidate will have a proven track record in designing, developing, and deploying robust and scalable data solutions on AWS.
Key Responsibilities :
Data Engineering :
- Develop, test, and deploy efficient data pipelines using Python and PySpark.
- Design and implement ETL processes to extract, transform, and load data from various sources.
- Optimize data pipelines for performance and scalability.
Cloud Architecture :
- Design and implement cloud-native solutions on AWS, leveraging services like EC2, Lambda, S3, RDS, Redshift, and Glue.
- Ensure the security, reliability, and cost-effectiveness of cloud infrastructure.
Data Management and Transformation :
- Manage and transform large datasets, supporting data ingestion and migration through well-defined pipelines.
- Utilize SQL Server and stored procedures for data management and transformation.
ETL and Orchestration :
- Develop, deploy, and manage scalable ETL and orchestration solutions to automate data processing tasks.
Team Leadership :
- Mentor and guide junior team members.
- Collaborate with cross-functional teams to deliver high-quality solutions.
Required Skills and Experience :
- Strong proficiency in Python and PySpark.
- In-depth knowledge of AWS services (EC2, Lambda, S3, RDS, Redshift, Glue).
- Experience with data warehousing and data lake concepts.
- Solid understanding of SQL and database technologies.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
- Experience with data visualization tools (i.e., Tableau, Power BI) is a plus
-
Python Developer With Pyspark
2 months ago
bangalore, India Andor Tech Full timeJob Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain...
-
Python / pyspark developer
2 months ago
Bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, Data Frames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence...
-
Python / Pyspark developer
2 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developerExp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for performance tuning.- Competence in programming...
-
Python / Pyspark developer
3 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developerExp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for performance tuning.- Competence in programming...
-
Python / Pyspark developer
3 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence in programming...
-
Python / Pyspark developer
3 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence in...
-
Senior Data Engineer
1 month ago
Bangalore, India SKYLARK HR SOLUTIONS Pvt Ltd Full timePosition : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...
-
HCLTech | Python Developer
5 days ago
bangalore, India HCLTech Full timeRole- Python Developer Location- PAN INDIA Experience- 8+years Notice period- Can join within 30 days or lessMust Skill: Looking for Python Developers with extensive experience with Pyspark
-
HCLTech | Python Developer
19 hours ago
bangalore, India HCLTech Full timeRole- Python Developer Location- PAN INDIA Experience- 8+years Notice period- Can join within 30 days or less Must Skill: Looking for Python Developers with extensive experience with Pyspark
-
bangalore, India Andor Tech Full timeJob Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain data...
-
bangalore, India Andor Tech Full timeJob Title: Python Developer with PySpark Location: Bengaluru (Work from Office) Job Summary: We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain...
-
bangalore, India Andor Tech Full timeJob Title: Python Developer with PySpark Location: Bengaluru (Work from Office) Job Summary: We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain...
-
Python/PySpark Developer
5 days ago
Bangalore, India Resource Quick Full timeKey Responsibilities : - Develop robust and scalable Python and PySpark applications to support data engineering and analytics initiatives.- Design and deploy cloud-native solutions on AWS, leveraging services like EC2, Lambda, S3, RDS, Redshift, and Glue.- Manage and transform large datasets, ensuring efficient data ingestion and migration through...
-
Data Analyst
1 month ago
Bangalore/Hyderabad, India ANRI Solutions HR Services Full timeJob Description : We are looking for a Data Analyst with 4-8 years of experience who is proficient in Python and PySpark. The successful candidate will analyze large datasets to extract meaningful insights and support data-driven :- Analyze and interpret complex data sets using Python and PySpark.- Develop and maintain dashboards and reports to visualize...
-
Pyspark Developer
2 months ago
Bangalore, India Tata Consultancy Services Full timePOSITION :Pyspark developer JOB LOCATION : Bangalore / Chennai / Pune / Delhi EXPERIENCE REQUIREMENT : 4 to 12 Years Mandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. Must have...
-
Data Engineer
1 month ago
Bangalore/Hyderabad, India ANRI Solutions HR Services Full timeJob Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...
-
Pyspark Developer
2 months ago
bangalore, India Tata Consultancy Services Full timePOSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...
-
Data Engineer Python+Pyspark
1 month ago
Bangalore, India Mopid Full timeData Engineer (Python + PySpark) Position Experience Range: 2-6 years Job Timing: This is a full-time position Job Type: The role is designed as a hybrid work arrangement We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of...
-
Senior Cloud Data Engineer
1 month ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, India Mouri Tech (P) Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, : - Minimum of 6-9 Experience with the core AWS Services and setting...
-
Tata Consultancy Services | Python
2 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence in...