Senior Data Engineer- Spark/Python

Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

Salary : 12-20 LPA Responsibilities :Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark, and...

Job Description :- Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub or...

Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python and Apache Spark. Your typical day will involve working with PySpark, performing data analysis and munging to extract insights and patterns from large data sets.Roles &...

Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

Key Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...

This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...

Job Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...

Job Description :Minimum 5+ years' Experience in Data Engineering.Must have good knowledge and experience in Python.Mush have good Knowledge of Pyspark or Spark.Mush have good Knowledge of Databricks.Must have good experience in AWS (Glue, EMR)Typically requires relevant analysis work and domain-area work experience.Expert in the management,...

Overview :- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.- This position is essential for...

Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...

Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning Overview :As a Senior Data Engineer, you will be responsible for architecting, implementing, and maintaining...

Job Bachelor's or advanced degree in Computer Science, Information Technology, or related field.- Proven experience as a Back-End Data Engineer or similar role.- Proficiency in database design and management (e.g., SQL, NoSQL).- Strong programming skills in languages such as Python, Java, or Scala.- Experience with ETL tools and data integration...