Senior Data Engineer- Spark/Python

Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

Our client is a leading player in the Digital Transformation space have 17 centers in USA and IndiaJob Description :- Analyze and organize raw data, developing and maintaining data systems and pipelines, and collaborating closely with data scientists and business analysts to ensure data quality and reliability.- Quickly grasp and translate business...

Role : Data Engineer - Spark StreamingExperience : 5+ yearsResponsibilities :- Develop and maintain real-time data pipelines using Spark Streaming.- Collaborate with cross-functional teams to understand and define data requirements for streaming applications.- Design and implement scalable and efficient data processing solutions using Python and Pyspark.-...

Job Description :- Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub or...

Job Description :- Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub or...

Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

Job Description :- 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation. - Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline. - Leveraged AWS Glue for data cataloging, ETL job orchestration, and...

Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python and Apache Spark. Your typical day will involve working with PySpark, performing data analysis and munging to extract insights and patterns from large data sets.Roles &...

Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python and Apache Spark. Your typical day will involve working with PySpark, performing data analysis and munging to extract insights and patterns from large data sets.Roles &...

Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

Responsibilities :- Collaborating with business teams to design systems architecture- Design and implement robust, scalable, and optimized data architectures.- Lead the development and maintenance of scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.Pipeline ownership :- Develop integrations...

Responsibilities :- Collaborating with business teams to design systems architecture- Design and implement robust, scalable, and optimized data architectures.- Lead the development and maintenance of scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.Pipeline ownership :- Develop integrations...

Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for...