Data Engineer- Spark

Data Engineer - SPARKApache Spark (Scala), Hadoop, and Hive, performance tuning, debugging, and optimization , Functional Programming, OOP principles, SOLID design, and design patterns, RDBMS, NoSQL database (preferably PostgreSQL), build tools (Maven), version control systems (Git), and CI/CD pipelines (Jenkins preferred), unit and integration tests using...

Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big DataProcessing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experienceon SOLID & DRY principles with Good Software Architecture & Designimplementation experience Advanced Scala experience (e.g. FunctionalProgramming, using Case classes, Complex Data Structures &...

Now Hiring: Spark / Data Pipeline Engineer (3–5 Years Experience)Location:Bengaluru, Karnataka, IndiaOpen (Prefer candidates from top universities or enterprise-level companies)We are looking for a talentedSpark / Data Pipeline Engineerto join our team and work on scalable, distributed data applications. If you're passionate about building and optimizing...

As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

Job Duties:At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.Strong Application development experience in Scala/Python. Strong Database SQL experience,...

Job description:Your Experience5 years of experience in large scale realtime stream processing using Apache Spark with messaging infrastructure like KafkaPulsar7 years of experience on Data Pipeline development ETL and processing of structured and unstructured data5 years of experience using NoSQL systems like MongoDB DynamoDB and SnowFlake AthenaExperience...

Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

Job Description:Scala, Spark, Apache Sqoop, Cloudera, Unix Shell scripting, CAAS.Experience: 4-6 yearsAt least four years of data engineering experience working with sophisticated data pipelines using Spark , Scala , ApacheSqoop, Cloudera , Unix Shell scripting and CAAS.Scala, Spark, Apache Sqoop, Cloudera, Unix Shell scripting, CAAS.Experience: 4-6 yearsAt...

Industry & SectorA technology services & software exports company operating in the Enterprise Data Engineering and Big Data Analytics sector. We build scalable data platforms, real-time streaming pipelines, and ETL systems that power analytics and data products for global enterprise customers.Primary Title (best-performing standardized title):Senior Data...

Below is the complete job descriptionData EngineerBangalore, IndiaHybridMust Have skills :Spark, Spark SQL, working experience with spark. Very Strong SQL, Batch Exp is a must have. Good Project Experience.Python is a plus not a must have.Data Engineer Job Description:Hands-on experience with Apache Spark (especially Spark SQL and batch processing).Strong...