Senior Big Data Engineer for Scalable Data Pipelines
2 weeks ago
We are seeking a highly skilled Big Data Developer to join our dynamic team at WEN. The ideal candidate will have hands-on experience in developing and optimizing data processing pipelines and possess strong expertise in big data technologies.
Job Description OverviewIn this role, you will be responsible for designing, implementing, and maintaining scalable data processing applications using Scala, Spark, and related big data technologies. You will also work with cross-functional teams to define, design, and deliver new features, as well as provide technical guidance on data architecture and infrastructure requirements.
Key Responsibilities- Develop, test, and deploy scalable data processing applications using Scala, Spark, and related big data technologies.
- Design and implement data pipelines to process structured and unstructured data.
- Write optimized and efficient code in Scala and Python/PySpark for data transformation and analysis.
- Work with SQL and NoSQL databases to manage and query large datasets.
- Integrate applications within the Hadoop ecosystem (HDFS, Hive, HBase, etc.).
- Proficiency in Scala coding with a solid understanding of functional programming concepts.
- Extensive experience with Apache Spark for data processing and analytics.
- Hands-on experience in Python/PySpark for data engineering tasks.
- Proficiency in querying and working with SQL/NoSQL databases (e.g., MongoDB, Cassandra).
- Familiarity with the Hadoop ecosystem and big data technologies.
- Prior experience in Java development is preferred.
- Strong problem-solving skills and the ability to optimize complex data workflows.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in big data development and distributed systems.
- Excellent communication and collaboration skills.
The estimated annual salary for this position is $140,000 - $160,000 depending on experience and qualifications. Additionally, WEN offers a comprehensive benefits package, including health insurance, retirement plans, and paid time off.
-
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full timeJob Description:Coders Brain Technology Private Limited is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and developing big data pipelines using AWS Databricks.About the Role:We are looking for a seasoned professional with hands-on experience in AWS Databricks, Spark, and...
-
Senior Cloud Data Architect
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeNTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...
-
Cloud Data Engineer for Big Data Processing
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...
-
Data Engineer for Big Data Pipelines
1 day ago
Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full timeWe are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...
-
Data Engineer
1 month ago
Bengaluru, Karnataka, India Nexthire Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our team and contribute to the design and development of scalable data pipelines.Main Responsibilities:Data Pipeline Design: Design, develop, and maintain scalable and robust data pipelines to support various data processing and analytics needs.Collaboration: Collaborate with data scientists,...
-
Big Data Engineer for Scalable Solutions
1 week ago
Bengaluru, Karnataka, India Tiger Analytics Full timeJob OverviewTiger Analytics is a global AI and analytics consulting firm that empowers organizations to harness the power of data and technology.We are seeking an experienced Big Data Engineer to join our team in Chennai, Hyderabad, or Bangalore. As a key member of our data engineering team, you will design, build, and maintain scalable data solutions on...
-
Senior Data Architect
6 days ago
Bengaluru, Karnataka, India AKIRA Insights Full timeAbout AKIRA InsightsAkira Insights is a boutique pure-play data and analytics consulting firm providing services to multinational corporations, large enterprises, and Fortune 500s from various sectors. The company's mission is to help businesses unlock valuable insights from their data.Job Title: Senior Data Architect (Big Data Engineer)We are seeking an...
-
Senior Big Data Engineer
6 days ago
Bengaluru, Karnataka, India IT Source Global Full timeJob Title: Senior Big Data EngineerJob Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at IT Source Global. As a Senior Big Data Engineer, you will be responsible for designing and implementing scalable, fault-tolerant data pipelines using Hadoop and Spark.Key Responsibilities:Design and implement data pipelines using...
-
Cloud Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...
-
Senior Big Data Specialist
1 week ago
Bengaluru, Karnataka, India Creencia Technologies Pvt Ltd Full timeJob Title: Senior Big Data SpecialistAbout the Role: We are seeking an experienced Senior Big Data Specialist to join our team at Creencia Technologies Pvt Ltd. The ideal candidate will have a strong background in designing and developing scalable data pipelines using Scala programming, Java, GCP, and Spark.Key Responsibilities: Design, develop, and maintain...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Nexthire Full timeRole SummaryWe are seeking an experienced Data Engineer to design, develop, and maintain scalable and robust data pipelines that support various data processing and analytics needs.This role involves collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.About the...
-
Big Data Engineer
3 weeks ago
Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full timekrtrimaIQ Cognitive Solutions is well prepared to transform organizations into Intelligent Enterprises.The RoleWe are seeking an experienced Scala Developer with a strong background in Kafka and Big Data technologies.You will work closely with our data engineering and AI teams to build and maintain high-performance data pipelines and applications.Key...
-
Data Engineering Senior Specialist
1 month ago
Bengaluru, Karnataka, India NTT DATA Services Full timeData Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Genpact Full timeAt Genpact, we empower businesses to create lasting value for their clients by leveraging our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.We are seeking a highly skilled Data Engineer - Scalable Data Pipelines Specialist to join our team.ResponsibilitiesAs a Data Engineer, you will work closely...
-
Cloud Data Engineer for Big Data Solutions
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...
-
Data Architect
2 weeks ago
Bengaluru, Karnataka, India Kognivera It Solutions Private Limited Full timeSeeking an experienced Data Architect with a proven track record in designing and implementing scalable big data solutions on distributed platforms. As a key member of our team, you will be responsible for architecting data products using AWS services, data warehousing tools, and designing data platforms.About UsKognivera It Solutions Private Limited is a...
-
Data Engineer with Scalable Pipeline Expertise
2 hours ago
Bengaluru, Karnataka, India Hexaware Technologies Full timeWe are seeking a skilled Data Engineer to join our team at Hexaware Technologies. This role will focus on designing and developing scalable data pipelines using Databricks and Apache Spark. The ideal candidate should have 5+ years of experience in data engineering and be proficient in integrating various data sources, including databases, APIs, and cloud...
-
Data Engineer for Scalable Data Pipelines
2 weeks ago
Bengaluru, Karnataka, India Acrocede Technologies Private Limited Full timeAcrocede Technologies Private Limited is seeking a highly skilled and experienced Data Engineer to join its dynamic team.The ideal candidate will have extensive experience working with Hadoop platforms, expertise in Spark, Python, SQL, and knowledge of cloud-based solutions using AWS services such as S3, Glue, and Lambda.This role requires the ability to...
-
Big Data Expert
1 week ago
Bengaluru, Karnataka, India KrtrimaIQ Cognitive Solution Full timeWe are seeking an experienced Big Data Expert to join KrtrimaIQ Cognitive Solution. This role requires hands-on expertise in big data technologies and the ability to design and implement robust data processing solutions.The ideal candidate should have over 5 years of experience with Kafka, PySpark, Python/Scala, Spark, SQL, and the Hadoop ecosystem. Key...