Spark SQL Developer

3 days ago


Pune, India Tech Mahindra Full time

Roles and Responsibilities

  • Collaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.
  • Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution times.
  • Provide production support by monitoring system logs files and performing root cause analysis on errors encountered during runtime.
  • Participate in code reviews to ensure adherence to coding standards and best practices.
  • Design, develop, test, deploy, and maintain large-scale data warehouses using AWS services such as S3, Redshift, Glue, etc.

Desired Candidate Profile

  • 3-5 years of experience in Data Warehousing with expertise in Spark SQL development.
  • Strong understanding of AWS services including S3, Redshift, Glue, Lambda functions etc. .
  • Proficiency in writing complex SQL queries for optimizing database performance.
  • Experience working on ETL processes using Python programming language.

  • Spark SQL Developer

    7 days ago


    Pune, Maharashtra, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Roles and ResponsibilitiesCollaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution...


  • Pune, India Orcapod Consulting Services Full time

    Duration of contract* 12 months Total Yrs. of Experience* 3+ Relevant Yrs. of experience* 3+ Detailed JD *(Roles and Responsibilities) Develop and maintain legacy application and new platform (Roleswap, Migration, Patching, Mandatory upgrades) Mandatory skills* Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,Kubernetes Desired skills* Camunda knowledge...


  • Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Duration of contract*12 monthsTotal Yrs. of Experience*3+Relevant Yrs. of experience*3+Detailed JD *(Roles and Responsibilities)Develop and maintain legacy application and new platform(Roleswap, Migration, Patching, Mandatory upgrades)Mandatory skills*Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,KubernetesDesired skills*Camunda knowledge of Camunda...

  • Scala/Spark Developer

    8 hours ago


    Bengaluru, Chennai, Pune, India Photon Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    About The Role   Develop, test, and deploy data processing applications using Apache Spark and Scala.Optimize and tune Spark applications for better performance on large-scale data sets.Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.Collaborate with data scientists, business...


  • Pune, India Citi Full time

    **Responsibilities**: - Bachelor’s degree (in Computer Science, Information Technology). - Must have good programming skills and should be aware of OOPS concept, design principles, data structures. - Good experience in Big Data technologies (A MUST) - HDFS. - Good knowledge of databases: Hive, Hbase. - Good knowledge in Apache Spark, Spark-SQL, UDF,...


  • Pune, India Wipro Full time

    Java+Spark Primary skill - Apache Spark Secondary skill - Java Strong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streaming Hands-on experience in any one of the programming languages (Java) Good understanding of distributed programming concepts. Experience in optimizing Spark DAG, and Hive queries on Tez Experience using tools...


  • Pune, India IDESLABS PRIVATE LIMITED Full time

    skills Spark-Scala Experience 6+ Years Location PAN INDIA Job type Contract to Hire Work Model Hybrid Hands on experience of 4-5 years on Spark-Scala combination Awareness of Hive DB Awareness and experience of working on Hadoop platform Good SQL knowledge NP

  • SQL Developer

    3 weeks ago


    Pune, Maharashtra, India Mobile Programming Full time

    Job Description- 3 to 5 Years of experience- Expertize in writing SQL queries - Must Have- Expertize in fine tune queries to meet SLA - Must Have- Good knowledge of database migration - Good to Have- Good knowledge of Shell script - Good to Have- Good knowledge of HiveQL SparkQL - Good to Have- Knowledge of data import and export - Good to Have- Knowledge of...


  • Kothrud, Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 1,00,000 - ₹ 15,00,000 per year

    PFB the detailed JD:�� Experience: 5 to 7+ years (Hands-on)�� Notice Period: 0-30 DaysMust Have: Proficiency in at least one of the following programming languages:Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end datastorage/processing pipeline Strong Experience in Spark...

  • Persistent Systems

    6 days ago


    Pune, India Persistent Systems Limited. Full time

    About Position : We are looking for Spark Scala developer with hands on experience on ETL, Azure Databricks.Role : Spark Scala DeveloperLocation : All Persistent LocationsExperience : 8+ YearsJob Type : Full Time EmploymentWhat You'll Do : - Design and Development : Design and develop scalable data processing applications using Apache Spark and...