Advanced PySpark

3 weeks ago

Visakhapatnam, India TEKNIKOZ Full time

Greetings from Teknikoz Experience : 9+Years Roles and ResponsibilitiesAdvanced PySpark (Expert Level - Required)- Mastery of DataFrame APIs and Spark SQL- Performance tuning: broadcast joins, caching strategies, shuffle reduction- Handling skewed data and optimizing wide transformations- Writing scalable, testable PySpark code with modular designDatabricks Expertise (Expert Level - Required)- Cluster sizing, autoscaling, and spot instance optimization- Job orchestration using Workflows with retries, alerts, and dependencies- Delta Lake: - OPTIMIZE with Z-Ordering - MERGE operations and schema evolution - Time travel and versioning- Use of Unity Catalog for data governance and access control- Monitoring via Databricks metrics and audit logsPostgreSQL (Required)- Query profiling and execution plan analysis- Indexing strategies for analytical workloads- Table partitioning and parallel query execution

  • Big Data Engineer

    3 days ago

    Visakhapatnam, India HARP Technologies and Services Full time

    Description : - Skill : Bigdata + Pyspark- Location : Hyderabad only- Experience : 5-9 Years- Notice Period : Immediate to 30 Days- Interview Mode : L1 Virtual / L2 F2F (Mandatory)- Work Mode : Hybrid- Skills required : Bigdata (Hadoop Hive, Impala, Spark) , pyspark, Python, Oracle, Exadata (RDBMS), Autosys, BitbucketJob Summary : We are seeking a Specialist...

  • Miracle Software Systems

    7 days ago

    Visakhapatnam, India Miracle Software Systems,Inc. Full time

    Description :Role : Sr.Azure Data EngineerJob Summary :We are seeking a highly skilled and experienced Sr. Azure Data Engineer to design, build, and optimize our next-generation data platform on Microsoft Azure.This role requires 5+ years of dedicated experience with Azure data services, focusing heavily on Azure Synapse Analytics and Azure Data Factory...

  • Data Engineer

    3 weeks ago

    Visakhapatnam, India Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant Experience only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working ExperiencePython and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent...