Spark Developer
4 weeks ago
We are seeking a highly skilled Spark Developer to join our team at ATech. As a Spark Developer, you will be responsible for designing and developing scalable distributed architectures using Apache Spark and Python.
Key Responsibilities:
- Design and develop data processing pipelines using Apache Spark and Python
- Develop ETL scripts for big data sources
- Optimize data processing and workflow automation for reports and dashboards
- Work with stakeholders to ensure end-to-end requirements are addressed
- Collaborate with the team to adhere to the Software Development Life Cycle (SDLC)
Requirements:
- Deep understanding of Apache Spark and Python programming
- Experience in developing data processing tasks using PySpark
- Knowledge of DevOps, version control, and containerization
- Experience with cloud services like AWS and/or Microsoft Azure
- Strong understanding of distributed systems and data engineering analytics platforms
Preferred Qualifications:
- Experience with data ingestion tools like Apache NiFi, Apache Airflow, Sqoop, and Oozie
- Hands-on experience with event-driven systems, message queues, and data processing at scale
- Experience with data warehouse exposure on Apache NiFi, Apache Airflow, and Kylo
- Operationalization of ML models on AWS
About ATech:
ATech is a leading technology company that provides innovative solutions to businesses. We are committed to delivering high-quality products and services that meet the evolving needs of our customers.
-
Spark/PySpark Developer
5 months ago
Bihar/Jharkhand/Maharashtra/Pondicherry/Coimbatore/Patna/Aurangabad/Ranchi/Mumbai/Navi Mumbai/Pune/N, IN ATech Full timeJob Profile : Spark ( Pyspark ) DeveloperIndustry Type : IT Services Job description :- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.-...
-
Big Data Engineer
2 weeks ago
Bihar/Jharkhand/Maharashtra/Pondicherry/Coimbatore/Patna/Aurangabad/Ranchi/Mumbai/Navi Mumbai/Pune/N, India ATech Full timeJob Responsibilities:• Develop scalable distributed architectures using Apache Spark and Python.• Design data processing pipelines for batch and real-time analytics on structured and unstructured data.• Work with stakeholders to ensure end-to-end requirements are addressed.• Collaborate with the team to adhere to the Software Development Life cycle...
-
Spark Developer
4 weeks ago
Mumbai, Maharashtra, India Robosoft Technologies Full timeJob DescriptionWe are seeking a highly skilled Spark, Scala Developer to join our team at Robosoft Technologies. The ideal candidate will have a strong background in big data processing, distributed systems, and cloud computing.Key Responsibilities:Design and develop scalable big data processing systems using Spark and Scala.Develop and maintain complex data...
-
Spark/PySpark Developer
5 months ago
Navi Mumbai, India ATech Full timeJob Profile : Spark ( Pyspark ) DeveloperIndustry Type : IT Services Job description :- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.-...
-
Java Spark Developer
4 weeks ago
Mumbai, Maharashtra, India Overture Rede Private Limited Full timeJob Title: Java Spark DeveloperThis is a remote position that requires a highly skilled Java developer with expertise in Spark and AWS.Key Responsibilities:Design and develop complex data platforms and data engineering solutions using Java and Spark.Develop and deploy scalable and highly available distributed systems for data extraction, ingestion, and...
-
Java Spark Developer
4 weeks ago
Mumbai, Maharashtra, India Overture Rede Private Limited Full timeJob Title: Java Spark DeveloperThis is a remote position with a focus on building complex data platforms and data engineering solutions using Java and Spark.Key Responsibilities:Design and develop scalable data pipelines using Java and SparkWork with big data technologies such as EMR, Hadoop, Hive, and NoSQL databases like DynamoDB, DocumentDB, and...
-
Java Spark Developer
4 weeks ago
Mumbai, Maharashtra, India Overture Rede Private Limited Full timeJob Title: Java Spark DeveloperThis is a remote position that requires a highly skilled Java Spark Developer to join our team at Overture Rede Private Limited.Key Responsibilities:Design and develop complex data platforms and data engineering solutions using Java and Spark.Develop and maintain large-scale data processing systems using AWS...
-
Java Spark Developer
3 weeks ago
Mumbai, Maharashtra, India Overture Rede Private Limited Full timeJob Title: Java Spark DeveloperOverture Rede Private Limited is seeking a highly skilled Java Spark Developer to join our team. The ideal candidate will have a strong background in Java and experience with Spark, AWS, and big data technologies.Key Responsibilities:* Design and develop complex data platforms and data engineering solutions using Java and...
-
Spark Developer
7 days ago
Pune, Maharashtra, India Wipro Full timeAbout the RoleWe are seeking a highly skilled Apache Spark Developer to join our team at Wipro. The ideal candidate will have excellent knowledge of the Spark framework, with a strong focus on performance tuning, and hands-on experience with Scala or PySpark.Responsibilities:Spark Framework Expertise: Develop and deploy efficient Spark applications,...
-
Scala/Spark Developer
2 weeks ago
Mumbai/Hyderabad/Chennai/Pune/Bangalore, India Monster.com Full timeJob Description : Skill : Scala and SparkMainly Scala + Spark experience needed.- 5+ years of experience- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks : Spark, HBase, Hive and other Hadoop ecosystem technologies. - Development using...
-
Scala/Spark Developer
1 month ago
Mumbai/Hyderabad/Chennai/Pune/Bangalore, IN Monster.com Full timeJob Description :Skill : Scala and SparkMainly Scala + Spark experience needed.- 5+ years of experience- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks : Spark, HBase, Hive and other Hadoop ecosystem technologies. - Development using Scala.-...
-
Scala/Spark Developer
3 weeks ago
Mumbai/Hyderabad/Chennai/Pune/Bangalore, India Monster Full timeJob Title: Scala/Spark DeveloperWe are seeking a highly skilled Scala/Spark Developer to join our team at Monster. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Scala and Spark.Key Responsibilities:Design and develop big data platforms using Scala and SparkDevelop expertise in data...
-
Spark, Scala Developer
5 months ago
Mumbai, India Robosoft Technologies Full timeTechnical/Functional Skills Must have 4+ years of IT experience Must have good experience in Spark and Scala Good to have experience instreaming systems like Spark streaming and Storm Experience with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, Scalability Good knowledge of Hive, Sqoop, Spark, Data...
-
Scala and Spark Developer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scala and Spark DeveloperJob Summary: We are seeking an experienced Scala and Spark developer to join our team at Virtusa. The ideal candidate will have a strong background in Scala and Spark, with a proven track record of delivering high-quality solutions.Key Responsibilities:Design and develop scalable and efficient Scala and Spark...
-
Senior Spark and Scala Developer
3 weeks ago
Mumbai/Pune/Bangalore, India Xoriant Solutions Full timeWe are seeking a highly skilled Senior Spark and Scala Developer to join our team. The ideal candidate will have extensive experience in designing and developing large-scale data processing systems using Spark and Scala.Key Responsibilities:Design and develop high-performance data processing systems using Spark and ScalaWork closely with cross-functional...
-
Senior Spark Engineer
7 days ago
Mumbai, Maharashtra, India Central Business Solutions Inc. Full timeJob Title: Senior Spark EngineerJob Summary:We are seeking a highly skilled Senior Spark Engineer to join our team at Central Business Solutions Inc. As a Senior Spark Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.Key Responsibilities:Design and develop efficient data...
-
Spark developer
4 days ago
mumbai, India Central Business Solutions Inc. Full timePls Share your resume with ashish.singh@cbsinfosys.com Title: Spark developer (Flink, Nifi, Pyspark) Duration: 2 months expectation to Extend Location: Bandra Kurla Complex, Mumbai, India Good to Have Skills : Flink and Kudu streaming Informatica workflow migration Automation of workflows CI/CD Nifi streaming and transformation Experience with...
-
Java Spark Developer
3 weeks ago
Mumbai, India Overture Rede Private Limited Full timeThis is a remote position. Key Points Must Have: Advanced Java proficient Microservices Spring boot Writing SQL Queries (proficient) AWS 45 Yrs in Java 23 exp Spark Good to have Unix Shell scripting JD Minimum of 8 years of experience in building complex Data Platforms and Data Engineering solutions Minimum of 6 years of hands on experience in architecture...
-
Java spark developer
3 weeks ago
Pune, India EXL Full timeWe are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...
-
Spark developer
2 days ago
mumbai, India Central Business Solutions Inc. Full timePls Share your resume withTitle: Spark developer (Flink, Nifi, Pyspark)Duration: 2 months expectation to ExtendLocation: Bandra Kurla Complex, Mumbai, IndiaGood to Have Skills :Flink and Kudu streamingInformatica workflow migrationAutomation of workflows CI/CDNifi streaming and transformationExperience with Airflow or other workflow engines.Job...