Python, Pyspark

18 hours ago

Bengaluru, India Ziniosedge Full time

Python, Pyspark

5

Technology Lead (Data Engineer)

BE
- 8+ years of industry experience as Lead Developer
- Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
- Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
- Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
- Advanced Proficiency in Python and SQL.
- Familiarity with Unix.
- Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
- Familiarity in cloud native tools - AWS is preferred
- Familiarity with CI/CD process from developer point of view.
- Familiarity with Change Data Capture systems is nice to have.
- Familiarity with Docker is nice to have

  • Developer (Python | PySpark)

    7 hours ago

    Bengaluru, Karnataka, India ONOC Full time ₹ 1,00,00,000 - ₹ 1,40,00,000 per year

    We're Hiring – Developer (Python | PySpark)Location: Chennai / BangaloreCTC: ₹13 – 14 LPAExperience: 8 – 10 YearsNotice Period: Max 20 DaysKey Responsibilities:Design, develop & maintain scalable data pipelines using PySpark on cloud (AWS / Azure / GCP)Write complex, optimized SQL queries for data extraction, transformation & analysisBuild automation...

  • Pyspark

    18 hours ago

    Bengaluru, India Riverforest Connections Full time

    Position Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...

  • Senior Data Engineer – Python

    4 weeks ago

    Bengaluru, India Xebia Full time

    🚀 We’re Hiring: Senior Data Engineer – Python & PySpark📍 Location: Bangalore (Hybrid – 3 days office per week)We are looking for an experienced Senior Data Engineer with a strong background in Python (with OOPs concepts), PySpark, and building test cases. The ideal candidate must have 6+ years of hands-on experience and be available to join...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Scoop Technologies Full time

    Job Data 7+ Skill : Python, Pyspark, Azure Data Bricks, Period : Immediate to 15 : Trivandrum, of Work : Hybrid Type : Full Skills & Experience :- Experience with large-scale distributed data processing systems.- Expertise in data modelling, testing, quality, access, and storage.- Proficiency in Python, SQL, and experience with Databricks and DBT.-...

  • Pyspark Developer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Limited Full time

    Job Description Title- Pyspark Developer Job Description Must-Have - Minimum 6-8years of experience in build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python; - Minimum 5 years of extensive experience in design, build and deployment of Python-based applications; - Design and develop ETL integration patterns using Python on Spark....

  • Incorta Developer

    3 weeks ago

    Bengaluru, India SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title : Incorta DeveloperExperience Level : 3+ YearsLocation : Pune/ Bangalore/ Hyderabad [Hybrid]Employment Type : Full-TimeAbout the Role : We are looking for a talented and detail-oriented Incorta Developer with 3+ years of experience to join our data engineering team. The ideal candidate will bring hands-on expertise in Incorta Analytics along with...

  • Python Developer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : Python Developer ( Python, Pyspark, Glue)Exp range: 5 yrs to 10 yrsLocation: Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, KolkataNotice period –30 daysPls find the Job Description below.1.experience as Python Developer / Designer with ETL.2. Performance Improvement...

  • Python Developer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : Python Developer ( Python, Pyspark, Glue)Exp range: 5 yrs to 10 yrsLocation: Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, KolkataNotice period –30 daysPls find the Job Description below.1.experience as Python Developer / Designer with ETL.2. Performance Improvement...

  • Python developer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : Python Developer ( Python, Pyspark, Glue)Exp range: 5 yrs to 10 yrsLocation: Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, KolkataNotice period –30 daysPls find the Job Description below.1.experience as Python Developer / Designer with ETL.2. Performance Improvement...

  • Python Developer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : Python Developer ( Python, Pyspark, Glue)Exp range: 5 yrs to 10 yrsLocation: Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, KolkataNotice period –30 daysPls find the Job Description below.1.experience as Python Developer / Designer with ETL.2. Performance Improvement...