Advanced PySpark

2 weeks ago


bangalore, India TEKNIKOZ Full time

Greetings from Teknikoz Experience : 9+Years Roles and Responsibilities Advanced PySpark (Expert Level - Required) - Mastery of DataFrame APIs and Spark SQL - Performance tuning: broadcast joins, caching strategies, shuffle reduction - Handling skewed data and optimizing wide transformations - Writing scalable, testable PySpark code with modular design Databricks Expertise (Expert Level - Required) - Cluster sizing, autoscaling, and spot instance optimization - Job orchestration using Workflows with retries, alerts, and dependencies - Delta Lake: - OPTIMIZE with Z-Ordering - MERGE operations and schema evolution - Time travel and versioning - Use of Unity Catalog for data governance and access control - Monitoring via Databricks metrics and audit logs PostgreSQL (Required) - Query profiling and execution plan analysis - Indexing strategies for analytical workloads - Table partitioning and parallel query execution



  • Bangalore, Karnataka, India NatWest Group Full time

    Join us as a Software Engineer - PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day you ll be engineering and maintaining innovative customer centric high performance secure and robust solutions It s a chance to hone your existing technical skills and advance your career while building a wide...


  • Bangalore, Karnataka, India NatWest Group Full time

    Join us as a Software Engineer PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day you ll be engineering and maintaining innovative customer centric high performance secure and robust solutions It s a chance to hone your existing technical skills and advance your career while building a wide...

  • Azure Data Engineer

    5 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services!!We are hiring for Data EngineerRequired Skillset: Python, Pyspark, Azure FunctionPython, Pyspark, Data bricksPython, Pyspark, Azure Function, Data BricksPython, Fast API, FlaskExperience : 5+yearsLocation : Azure, ADF, Databricks, PythonJob Description:Expertise in Python programming language and frameworksStrong...

  • Azure Data Engineer

    5 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services!! We are hiring for Data Engineer Required Skillset: Python, Pyspark, Azure Function Python, Pyspark, Data bricks Python, Pyspark, Azure Function, Data Bricks Python, Fast API, Flask Experience : 5+years Location : Azure, ADF, Databricks, Python Job Description: Expertise in Python programming language and frameworks...

  • Python Developer

    1 day ago


    bangalore, India xTag Full time

    𝗝𝗼𝗯 𝗿𝗼𝗹𝗲 – 𝗣𝘆𝘁𝗵𝗼𝗻 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗿𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: Remote (India)𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲: 5–7 Years𝗔𝗯𝗼𝘂𝘁 𝘁𝗵𝗲 𝗥𝗼𝗹𝗲:We’re looking for an experienced Python Developer with a strong background in Azure cloud services and ETL...

  • Snowflake Architect

    2 weeks ago


    bangalore, India Bahwan CyberTek Full time

    Job Title: Snowflake Architect Location: [Chennai / Bengaluru / Pune / Mumbai or Remote] Experience Required: 10+ Years Employment Type: [Full-Time] Role Overview: We are seeking a highly skilled Snowflake Architect to design and implement scalable, secure, and high-performance data architectures using Snowflake. The ideal candidate will have deep expertise...

  • AI / ML Data Engineer

    2 weeks ago


    bangalore, India Tata Consultancy Services Full time

    Role: AI / ML Data Engineer Experience Required: 5 to 8 Years Location: Pune (Onsite ) Drive Type: Walk-In Interview Walk-In Date & Time: 30th Oct Must-Have Technical Skills AI / Machine Learning (Model Development & Deployment) Azure Cloud Platform (ADF, Data Lake, Synapse, Azure ML, DevOps) Azure Databricks (ADB) PySpark (Advanced Data Transformation & Big...

  • Data Engineer

    3 days ago


    bangalore, India Response Informatics Full time

    1. Cloud & Infrastructure• AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.• Snowflake: Moderate understanding of Snowflake architecture.• CICD - Terraform or CloudFormation, Jenkins ,Bitbucket : For infrastructure-as-code and deployment automation.2. Programming & Scripting• Python &...

  • Senior Data Architect

    2 weeks ago


    bangalore, India Spectral Consultants Full time

    We’re Hiring | Data Architect / Senior Data Architect (Azure + Databricks) Locations: Chennai | Bangalore | Hyderabad Experience: 9–16 Years | Hybrid Work Model Role Overview As a Data Architect / Senior Data Architect , you’ll lead the design, development, and delivery of cutting-edge data platforms leveraging Azure, Databricks, and GenAI technologies...

  • Data Engineer

    2 days ago


    bangalore, India IntraEdge Full time

    Websitehttp://www.intraedge.comJob Title: Data EngineerExperience: 5–9 yearsLocation: [Remote]Job Summary:We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda), and Snowflake. The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable...