Python, Pyspark

7 days ago


Bengaluru, India Ziniosedge Full time

Python, Pyspark

5

Technology Lead (Data Engineer)

BE
- 8+ years of industry experience as Lead Developer
- Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
- Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
- Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
- Advanced Proficiency in Python and SQL.
- Familiarity with Unix.
- Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
- Familiarity in cloud native tools - AWS is preferred
- Familiarity with CI/CD process from developer point of view.
- Familiarity with Change Data Capture systems is nice to have.
- Familiarity with Docker is nice to have


  • Python/pyspark

    2 weeks ago


    Bengaluru, India Cognizant Technology Solutions Full time

    **Python/Pyspark Engineer** **Job Location: Bangalore/Willing to relocate to Bangalore** **Exp: 4 to 12 years** **Introduction**: We work with customers who need to improve their capacity to respond on computerized world and empower adaptability, evacuate execution boundaries, empower advancement, and modernize center frameworks and rethink their business...

  • Python+Pyspark

    3 weeks ago


    Bengaluru, India Wissen Full time

    Wissen Technology is now hiringPython+PysparkWe are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and...

  • Python+Pyspark

    1 week ago


    Bengaluru, Karnataka, India Wissen Full time

    Wissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...


  • Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...

  • Python+Pyspark

    3 weeks ago


    Bengaluru, India Wissen Full time

    Wissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...

  • Python Pyspark Lead

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...


  • Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...

  • Pyspark

    1 week ago


    Bengaluru, Karnataka, India Riverforest Connections Full time

    Position Purpose For the projects which are implemented on Data SSC platform, we need senior developer for python- pyspark development to migrate project from spark/scala to python-pyspark._ResponsibilitiesDirect ResponsibilitiesDesign high quality deliverables adhering to business requirement with defined standards and design principles, patternsDevelop and...

  • Data Engineer

    6 hours ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team. In this role, you will design, develop, and optimize data pipelines and workflows to support our data infrastructure and analytics needs. Your contributions will be crucial in ensuring the reliability, scalability, and performance of our data...

  • ML Engineer

    2 months ago


    Bengaluru, India Petals Careers Full time

    Requirements :- Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions.- Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...


  • Bengaluru, Karnataka, India krazy mantra hr solutions Full time

    Apply for Hiring For Data Bricks With Python/Pyspark, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on

  • Bigdata + Pyspark

    1 week ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark :Big Data; Hadoop / HDFS,Pyspark,PythonExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software developmentProficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...

  • Bigdata + Pyspark

    1 week ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark : Big Data; Hadoop / HDFS,Pyspark,Python Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...

  • Data Engineer

    2 months ago


    Bengaluru, India IBU Consulting Full time

    Job Description :Duties and Responsibilities :- Maintain knowledge of evolving industry trends, practices, techniques, and standards on Big Data with a focus on AWS cloud technologies and Python/Pyspark from an application development perspective.- Be aware of DevOps practices and follow appropriate steps/tools to effect code migration during development...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...

  • Data Developer

    6 days ago


    Bengaluru, India Airbus Full time

    Description:You will join the Airbus (DCS) organization in charge of the BigData Developments &Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...

  • Aws Pyspark

    3 weeks ago


    Bengaluru, India Cognizant Full time

    Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark. Hands on experience with EMR Apache Spark...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    SN Required Information Details 1 Role PySpark Developer 2 Required Technical Skill Set PySpark, Python, HDFS, Hadoop, SQL 3 No of Requirements 02 4 Desired Experience Range 5+ years Location of Requirement India Desired Competencies (Technical/Behavioral Competency) Must-Have Sound...

  • Aws Pyspark

    1 week ago


    Bengaluru, Karnataka, India Cognizant Full time

    Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data BricksExperience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on experience with EMR Apache Spark...


  • Bengaluru, Karnataka, India Virtusa Full time

    Role: Data Engineer1) Minimum of 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS2) Required Domain: Healthcare3) Extensive data analysis skills and Good communication skills Writing scalable code using Python programming language. Developing back-end components. Integrating user-facing elements using...