Advanced PySpark

1 week ago


Bengaluru, India TEKNIKOZ Full time

Greetings from TeknikozExperience : 9+YearsRoles and ResponsibilitiesAdvanced PySpark (Expert Level - Required)- Mastery of DataFrame APIs and Spark SQL- Performance tuning: broadcast joins, caching strategies, shuffle reduction- Handling skewed data and optimizing wide transformations- Writing scalable, testable PySpark code with modular designDatabricks Expertise (Expert Level - Required)- Cluster sizing, autoscaling, and spot instance optimization- Job orchestration using Workflows with retries, alerts, and dependencies- Delta Lake:- OPTIMIZE with Z-Ordering- MERGE operations and schema evolution- Time travel and versioning- Use of Unity Catalog for data governance and access control- Monitoring via Databricks metrics and audit logsPostgreSQL (Required)- Query profiling and execution plan analysis- Indexing strategies for analytical workloads- Table partitioning and parallel query execution


  • Advanced PySpark

    1 week ago


    Bengaluru, India TEKNIKOZ Full time

    Greetings from Teknikoz Experience : 9+Years Roles and Responsibilities Advanced PySpark (Expert Level - Required) - Mastery of DataFrame APIs and Spark SQL - Performance tuning: broadcast joins, caching strategies, shuffle reduction - Handling skewed data and optimizing wide transformations - Writing scalable, testable PySpark code with modular design...

  • Advanced PySpark

    1 week ago


    Bengaluru, India TEKNIKOZ Full time

    Greetings from Teknikoz Experience : 9+Years Roles and Responsibilities Advanced PySpark (Expert Level - Required) - Mastery of DataFrame APIs and Spark SQL - Performance tuning: broadcast joins, caching strategies, shuffle reduction - Handling skewed data and optimizing wide transformations - Writing scalable, testable PySpark code with modular design...

  • Advanced PySpark

    1 week ago


    Bengaluru, India TEKNIKOZ Full time

    Greetings from TeknikozExperience : 9+YearsRoles and ResponsibilitiesAdvanced PySpark (Expert Level - Required)- Mastery of DataFrame APIs and Spark SQL- Performance tuning: broadcast joins, caching strategies, shuffle reduction- Handling skewed data and optimizing wide transformations- Writing scalable, testable PySpark code with modular designDatabricks...

  • Pyspark Developer

    2 weeks ago


    Bengaluru, India Tata Consultancy Services Limited Full time

    Job Description Title- Pyspark Developer Job Description Must-Have - Minimum 6-8years of experience in build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python; - Minimum 5 years of extensive experience in design, build and deployment of Python-based applications; - Design and develop ETL integration patterns using Python on Spark....


  • Bengaluru, Karnataka, India BirlaSoft Full time

    Country/Region: IN - Requisition ID: 25276 - Work Model: - Position Type: - Salary Range: - Location: INDIA - BENGALURU - HP **Title**:Azure Databricks with Pyspark**: - Description: **Area(s) of responsibility**: Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise...

  • Pyspark Developer

    2 weeks ago


    Bengaluru - BCIT, India Synechron Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Lead Pyspark Developer Overall Responsibilities:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy. Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs,...


  • Bengaluru, Karnataka, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Engineer, PySpark, AVP Join us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It's a chance to hone your existing technical skills and advance your career We're offering...


  • Bengaluru, Karnataka, India NatWest Group Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    Software Engineer, PySpark, VP Join us as a Software Engineer, PySparkThis is an opportunity for a technically minded individual to join us as a Software Engineer You'll be designing, producing, testing and implementing working software, working across the lifecycle of the system Hone your existing software engineering skills and advance your career...


  • Bengaluru, Karnataka, India EduRun Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer | 10-12 Years Experience | Must Have: Proven expertise in building scalable batch and streaming data pipelines using Databricks (PySpark) and Snowflake.Lead the design, implementation, and optimization of application data stores using PostgreSQL, DynamoDB, and advanced SQL.Strong programming skills in SQL, Python, and PySpark for...

  • Advanced pyspark

    1 week ago


    Bengaluru, India TEKNIKOZ Full time

    Greetings from TeknikozExperience : 9+YearsRoles and ResponsibilitiesAdvanced Py Spark (Expert Level - Required)- Mastery of Data Frame APIs and Spark SQL- Performance tuning: broadcast joins, caching strategies, shuffle reduction- Handling skewed data and optimizing wide transformations- Writing scalable, testable Py Spark code with modular designDatabricks...