Python/Pyspark Developer
2 weeks ago
We are looking for a skilled Python PySpark Developer with 34 years of experience in designing, developing, and maintaining big data solutions. The ideal candidate will have hands-on expertise in Python, PySpark, and data pipeline development, along with strong problem-solving skills and the ability to work in a collaborative environment.
Key Responsibilities :
- Develop, optimize, and maintain scalable data pipelines using PySpark and Python.
- Work with large-scale data sets for extraction, transformation, and loading (ETL).
- Collaborate with data engineers, analysts, and business stakeholders to deliver high-quality solutions.
- Implement performance tuning and debugging of PySpark jobs for efficiency.
- Ensure data integrity, security, and compliance in all workflows.
- Write clean, maintainable, and reusable code with proper documentation.
- Troubleshoot issues and provide quick resolutions in production environments.
Required Skills & Qualifications :
- Bachelors degree in Computer Science, IT, or related field.
- 3 to 4 years of experience in Python and PySpark development.
- Strong understanding of Spark architecture and distributed computing concepts.
- Hands-on experience with ETL processes, data wrangling, and data modeling.
- Proficiency in SQL and experience working with relational databases (e.g., MySQL, PostgreSQL, Oracle).
- Familiarity with big data platforms like Hadoop, Databricks, or AWS EMR.
- Experience in performance tuning of Spark jobs.
- Good problem-solving skills and ability to work in an agile environment.
Good to Have (Preferred Skills) :
- Experience with cloud platforms (AWS / Azure / GCP).
- Knowledge of Airflow, Kafka, or other workflow orchestration tools.
- Exposure to Docker / Kubernetes for containerized deployments.
- Familiarity with CI/CD pipelines and Git version control.
-
Python/Pyspark Developer
1 day ago
Gurgaon, Haryana, India DGLiger Consulting Pvt ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLocation: Gurgaon ( Work from office) We are looking for a Python PySpark Developer with 34 years of experience, primarily focused on Python programming and automation using GitHub Actions. The ideal candidate will be responsible for developing scalable Python-based data workflows, writing PySpark scripts for large-scale data processing, and implementing...
-
Python PySpark Developer
2 weeks ago
Gurgaon, Haryana, India Gokaimizu Full time ₹ 8,00,000 - ₹ 12,00,000 per yearResponsibilities:* Design, develop, and maintain PySpark applications using Python and Spark.* Collaborate with cross-functional teams on data engineering projects.Health insuranceProvident fund
-
Python Developer with Pyspark
2 weeks ago
Gurgaon, Haryana, India Programming Full time ₹ 12,00,000 - ₹ 18,00,000 per yearPython DeveloperGurugram5+ YearsBudget- 12 lpaProfessional & Technical Skills:Must To Have Skills: Proficiency in Python (Programming Language)Good To Have Skills: Experience with PySpark- Strong understanding of software development principlesExperience in designing and implementing scalable applicationsKnowledge of database management systemsAbility to...
-
Python Software Developer
1 day ago
Gurgaon, Haryana, India Gokaimizu Full time ₹ 9,00,000 - ₹ 12,00,000 per yearResponsibilities:* Design, develop, test and maintain Python applications using PySpark and SQL.* Collaborate with cross-functional teams on project requirements and deliverables.Provident fundHealth insurance
-
Python Data Engineer
3 days ago
Gurgaon, Haryana, India Digitrix Software LLP Full time ₹ 8,00,000 - ₹ 24,00,000 per yearLocation: Bangalore / Pune / Kolkata / Hyderabad / GurugramData Engineer4+ experiencePython, AWS Python (core language skill) -- Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda)Data Processing: Spark (PySpark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMRContainerization:...
-
Gurgaon, Haryana, India Niva Bupa Health Insurance Full time ₹ 5,00,000 - ₹ 15,00,000 per yearNiva Bupa Health Insurance Company Limited is hiringPython/Pyspark Mandatory*DataBricks / Qliksense - Assistant Manager - Data Analyst*Gurgaon Sector 59. The role is onsite with face-to-face interviews only*Key Requirements:*2-5 years of experience in data analysis, preferably in insuranceExperience managing large volume dataStrong technical skills in:Python...
-
Data Engineer(Pyspark+SQL)
2 weeks ago
Gurgaon, Haryana, India Accolite Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAbout The RoleWe are seeking an experienced Data Engineer to design, implement, and optimize a global data handling and synchronization solution across multiple regions. You will work with cloud-based databases, data lakes, and distributed systems, ensuring compliance with data residency and privacy requirements (e.g., GDPR).Requirements6+ years of...
-
Software Engineer, PySpark, AVP
2 weeks ago
Gurgaon, Haryana, India RBS Full time ₹ 15,00,000 - ₹ 28,00,000 per yearJoin us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWe're offering this role at associate vice presidentWhat...
-
Python Developer
2 weeks ago
Gurgaon, Haryana, India Ahom Technologies Private Limited Full time ₹ 70,00,000 - ₹ 7,20,00,000 per yearExpertise in Pyspark, AWS Big Data Stack, Kafka SQLExperience in big dataDevelop and optimize the data warehousesStrong experience with GCP data services, including Big Query, Data flow,Experience in implementing data governance on GCPFamiliar with other platforms like Snowflow, Data bricks etc.Experience with containerization solutions using Google...
-
Software Engineer, PySpark
6 days ago
Gurgaon, Haryana, India RBS Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJoin us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutionsIt's a chance to hone your existing technical skills and advance your career while building a wide...