Spark

**Java Spark**: Location: CHE, HYD, BLR, PUN, MUM, GGN Design and implement efficient data handling system based on Java and Spark. Perform and oversee tasks such as programming, writing scripts, calling APIs, and writing complex SQL queries. Implement data stores that support the scalable processing and storage of our high-frequency data. Skill Sets Must...

Position: Senior Data Engineer – Experience: 6–9 YearsRole SummaryWe are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality...

Position: Senior Data Engineer – Experience: 6–9 Years Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality...

Hiring for Spark Scala AWS KOLKATA HYDERABAD Design and develop robust scalable data pipelines using Apache Spark Core SQL Streaming MLlib etc with Scala Write clean modular production-grade Scala code adhering to coding standards and best practices Optimize Spark jobs for performance reliability and cost-efficiency including tuning Spark configurations and...

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is...

**Job Summary** **Responsibilities** - Develop and maintain data pipelines using Apache Airflow to ensure efficient data processing and workflow automation. - Utilize Hive for data warehousing solutions ensuring data is stored and queried effectively. - Write and optimize SQL queries to manage and manipulate data across various databases. - Implement and...

**About Spark Digital Ads** Spark Digital Ads is a 360 degree marketing agency dedicated to helping brands grow through **creative strategies and result-driven campaigns.** We specialize in **social media management, performance marketing, Offline and Online branding, content creation, website development, and video production.** Our team works closely...

Experience of 6-8 yrs AWS Glue jobs to handle large scale ETL workflows across diverse data sources Collaborate with data engineers and analysts to implement business logic and data transformations efficiently implement robust error handling, logging and performance tuning for high-throughput data pipelines. Ensure code quality reusability and deployment...

Role Summary: Design, build, and optimize large-scale ETL and data-processing pipelines handling GB–TB volumes. Operate within the Databricks ecosystem and drive migration of selected workloads to high-performance engines such as Polars and DuckDB. Maintain strong engineering rigor across CI/CD, testing, and code-quality enforcement. Apply analytical...

**Overview**: GCP all services (Pubsub, BQ, Airflow, data proc, cloud composer, gcs) +Teradata Pyspark/Spark **Responsibilities**: GCP all services (Pubsub, BQ, Airflow, data proc, cloud composer, gcs) + Teradata Pyspark/Spark **Requirements**: GCP all services (Pubsub, BQ, Airflow, data proc, cloud composer, gcs) + Teradata Pyspark/Spark