
Spark SQL Developer
3 days ago
Roles and Responsibilities
- Collaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.
- Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution times.
- Provide production support by monitoring system logs files and performing root cause analysis on errors encountered during runtime.
- Participate in code reviews to ensure adherence to coding standards and best practices.
- Design, develop, test, deploy, and maintain large-scale data warehouses using AWS services such as S3, Redshift, Glue, etc.
Desired Candidate Profile
- 3-5 years of experience in Data Warehousing with expertise in Spark SQL development.
- Strong understanding of AWS services including S3, Redshift, Glue, Lambda functions etc. .
- Proficiency in writing complex SQL queries for optimizing database performance.
- Experience working on ETL processes using Python programming language.
-
Spark SQL Developer
7 days ago
Pune, Maharashtra, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 28,00,000 per yearRoles and ResponsibilitiesCollaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution...
-
Python and Spark developer
3 days ago
Pune, India Orcapod Consulting Services Full timeDuration of contract* 12 months Total Yrs. of Experience* 3+ Relevant Yrs. of experience* 3+ Detailed JD *(Roles and Responsibilities) Develop and maintain legacy application and new platform (Roleswap, Migration, Patching, Mandatory upgrades) Mandatory skills* Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,Kubernetes Desired skills* Camunda knowledge...
-
Python and Spark developer
5 days ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per yearDuration of contract*12 monthsTotal Yrs. of Experience*3+Relevant Yrs. of experience*3+Detailed JD *(Roles and Responsibilities)Develop and maintain legacy application and new platform(Roleswap, Migration, Patching, Mandatory upgrades)Mandatory skills*Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,KubernetesDesired skills*Camunda knowledge of Camunda...
-
Scala/Spark Developer
8 hours ago
Bengaluru, Chennai, Pune, India Photon Full time ₹ 6,00,000 - ₹ 8,00,000 per yearAbout The Role Develop, test, and deploy data processing applications using Apache Spark and Scala.Optimize and tune Spark applications for better performance on large-scale data sets.Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.Collaborate with data scientists, business...
-
Java/scala +spark Developer-3
1 week ago
Pune, India Citi Full time**Responsibilities**: - Bachelor’s degree (in Computer Science, Information Technology). - Must have good programming skills and should be aware of OOPS concept, design principles, data structures. - Good experience in Big Data technologies (A MUST) - HDFS. - Good knowledge of databases: Hive, Hbase. - Good knowledge in Apache Spark, Spark-SQL, UDF,...
-
Java Spark Developer
3 days ago
Pune, India Wipro Full timeJava+Spark Primary skill - Apache Spark Secondary skill - Java Strong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streaming Hands-on experience in any one of the programming languages (Java) Good understanding of distributed programming concepts. Experience in optimizing Spark DAG, and Hive queries on Tez Experience using tools...
-
Spark-Scala Professional
3 days ago
Pune, India IDESLABS PRIVATE LIMITED Full timeskills Spark-Scala Experience 6+ Years Location PAN INDIA Job type Contract to Hire Work Model Hybrid Hands on experience of 4-5 years on Spark-Scala combination Awareness of Hive DB Awareness and experience of working on Hadoop platform Good SQL knowledge NP
-
SQL Developer
3 weeks ago
Pune, Maharashtra, India Mobile Programming Full timeJob Description- 3 to 5 Years of experience- Expertize in writing SQL queries - Must Have- Expertize in fine tune queries to meet SLA - Must Have- Good knowledge of database migration - Good to Have- Good knowledge of Shell script - Good to Have- Good knowledge of HiveQL SparkQL - Good to Have- Knowledge of data import and export - Good to Have- Knowledge of...
-
Sr. Spark Big Data Developer
2 weeks ago
Kothrud, Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 1,00,000 - ₹ 15,00,000 per yearPFB the detailed JD:�� Experience: 5 to 7+ years (Hands-on)�� Notice Period: 0-30 DaysMust Have: Proficiency in at least one of the following programming languages:Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end datastorage/processing pipeline Strong Experience in Spark...
-
Persistent Systems
6 days ago
Pune, India Persistent Systems Limited. Full timeAbout Position : We are looking for Spark Scala developer with hands on experience on ETL, Azure Databricks.Role : Spark Scala DeveloperLocation : All Persistent LocationsExperience : 8+ YearsJob Type : Full Time EmploymentWhat You'll Do : - Design and Development : Design and develop scalable data processing applications using Apache Spark and...