Python, Pyspark

2 days ago

Bengaluru, India Ziniosedge Full time

Python, Pyspark

5

Technology Lead (Data Engineer)

BE
- 8+ years of industry experience as Lead Developer
- Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
- Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
- Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
- Advanced Proficiency in Python and SQL.
- Familiarity with Unix.
- Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
- Familiarity in cloud native tools - AWS is preferred
- Familiarity with CI/CD process from developer point of view.
- Familiarity with Change Data Capture systems is nice to have.
- Familiarity with Docker is nice to have

  • Python,pyspark with Aws

    4 days ago

    Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...

  • Python Pyspark Lead

    1 week ago

    Bengaluru, India Virtusa Full time

    Python Pyspark Lead - CREQ Description Design and develop on Hadoop applications, Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALA Experience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance concepts Experience on source code management with Git repositories Secondary skills ...

  • Pyspark, Python, SQL

    6 days ago

    Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...

  • Python + Pyspark + SQL

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Our Client is a professional services firm, is the Indian member firm affiliated with International and wasestablished in September 1993. Our professionals leverage the global network of firms, providing detailedknowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad,Bengaluru, Chandigarh, Chennai,...

  • Senior Data Engineer

    4 days ago

    Bengaluru, India Xebia Full time

    We’re Hiring: Senior Data Engineer – Python & PySpark Location: Bangalore (Hybrid – 3 days office per week)We are looking for an experienced Senior Data Engineer with a strong background in Python (with OOPs concepts), PySpark, and building test cases . The ideal candidate must have 6+ years of hands-on experience and be available to join immediately...

  • ML Engineer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS presents an excellent Opportunity For "ML Engineer (Python, PySpark & statistical)" RoleJob Description1 Role - ML Engineer (Python, PySpark & statistical)2 Location of Requirement - Chennai, Bangalore, Kochi, Pune, Bhubaneswar3 Experience Range - 6 to 8 YearsDesired CompetenciesStrong SQL and Python coding skillsWorked with distributed data...

  • Pyspark

    2 days ago

    Bengaluru, India Riverforest Connections Full time

    Position Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...

  • Senior Data Engineer – Python

    4 days ago

    Bengaluru, India Xebia Full time

    🚀 We’re Hiring: Senior Data Engineer – Python & PySpark📍 Location: Bangalore (Hybrid – 3 days office per week)We are looking for an experienced Senior Data Engineer with a strong background in Python (with OOPs concepts), PySpark, and building test cases. The ideal candidate must have 6+ years of hands-on experience and be available to join...

  • Senior Data Engineer – Python

    3 days ago

    Bengaluru, India Xebia Full time

    🚀 We’re Hiring: Senior Data Engineer – Python & PySpark📍 Location: Bangalore (Hybrid – 3 days office per week)We are looking for an experienced Senior Data Engineer with a strong background in Python (with OOPs concepts), PySpark, and building test cases. The ideal candidate must have 6+ years of hands-on experience and be available to join...

  • Senior Data Engineer – Python

    4 days ago

    Bengaluru, India Xebia Full time

    🚀 We’re Hiring: Senior Data Engineer – Python & PySpark 📍 Location: Bangalore (Hybrid – 3 days office per week) We are looking for an experienced Senior Data Engineer with a strong background in Python (with OOPs concepts), PySpark, and building test cases. The ideal candidate must have 6+ years of hands-on experience and be available to join...