Big Data Developer
6 days ago
Position: Senior Data Engineer – Vendor Experience: 6–12 Years Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads. Key Responsibilities Develop and optimize data pipelines using Spark 3.5 and Python/Scala. Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT-based workflows. Integrate data pipelines with messaging systems (Kafka, Solace) and object stores (S3, MinIO). Troubleshoot and optimize distributed jobs running in Kubernetes environments. Collaborate closely with internal leads and architects to implement best practices. Design and implement migration/acceleration framework to automate end to end migration. Continuous enhancements to the frameworks to ensure the stability, scalability and support for diverse use cases and scenarios. Work with various data applications to enable and support the migration process. Deliver assigned migration tasks within agreed timelines. Required Skills 6–9 years of hands-on data engineering experience. Strong expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred). Experience working with Kafka, Solace, and object stores (S3, MinIO). Exposure to Docker/Kubernetes for deployment. Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi
-
Big Data Developer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeGreetings from TCS!!!TCS is currently hiring for the position of Big Data Developer. - **Role:** Big Data Developer- **Desired Experience Range:** 5-10 years- **Location:** BangaloreJob descriptionMust Have2-4 in development projects involving below technologiesStrong knowledge in Core Java -Strong knowledge on Python, Hive, HDFS, Scala, Impala, Yarn, Oozie,...
-
Senior Big Data Developer
5 days ago
bangalore, India beBeeBigDataExpert Full timeUnlock Big Data ExpertiseWe're seeking a seasoned Big Data Professional with 6+ years of experience in the high-tech industry or IT sector, boasting skills in data development.Data Analysis and Processing: Utilize big data technologies such as Spark to analyze, organize, and process raw data.Data Validation and Transformation: Employ big data technologies,...
-
Big Data Developer
2 weeks ago
bangalore, India beBeeData Full timeJob OpportunityThe primary role of the Big Data Developer is to design and implement scalable data processing solutions using Azure Databricks.Develop robust data pipelines and workflows utilizing Azure Databricks services.Collaborate with cross-functional teams including data engineers, architects, and business analysts to gather and analyze...
-
Big Data Developer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeTCS is Hiring Big Data Developer For Chennai and Bangalore location Experience : 4 - 10 years Mode of interview : Virtual Location : Chennai, Bangalore JOB DESCRIPTION: Must have: Hadoop,Spark, Pyspark, Hive, Scala Good to have: Agile and good communication skills Responsibilities: Ingest data from disparate sources (Structured, unstructured and...
-
Big Data Developer
2 weeks ago
bangalore, India Impetus Full timeAbout Impetus Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders providing...
-
Big Data Specialist
6 days ago
bangalore, India beBeeData Full timeJob Role: Big Data SpecialistWe are seeking a skilled Big Data Specialist to join our team. As a key member of our data analytics group, you will play a crucial role in developing and implementing advanced big data solutions.Location: BangaloreExperience: 6+ yearsType of Hire: PermanentTechnical Skills:6 to 8 years of experience on application development...
-
Big Data Developer
7 days ago
bangalore, India Xebia Full timeJob Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...
-
Big Data Developer
1 week ago
bangalore, India Xebia Full timeJob Title : Big Data Developer - Spark/Scala Job location : Bengaluru Notice Period : immediate - 15 days Position Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud .. Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...
-
Gcp Big Data Developer
2 weeks ago
Bangalore, India Impetus Full time```html About the Company Must have: Bigdata, GCP, Dataproc, Dataflow, SQL, Spark About the Role Must have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services). Responsibilities Should be aware with columnar database e.G. parquet, ORC etc....
-
GCP Big Data Developer
2 weeks ago
Bangalore, India Impetus Full time```html About the Company Must have: Bigdata, GCP, Dataproc, Dataflow, SQL, Spark About the Role Must have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services). Responsibilities Should be aware with columnar database e.g. parquet, ORC etc....
