Spark Engineer

We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

Job Title : Big Data DeveloperJob Description :- Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL...

Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

Key Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...

Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

Job Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...

Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...

Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

Job Description :- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear &...

Manager - Data EngineerJob Responsibilities :- Create and maintain optimal data pipeline architecture,- Assemble large, complex data sets that meet functional/non-functional business requirements.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...

Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

Salary : 12-20 LPA Responsibilities :Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark, and...

About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...