Current jobs related to Studios - Data Engineer - Hive/Spark - Bengaluru, Karnataka - CAW

  • Big Data Engineer – Spark

    3 weeks ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & Analytics Job Description • Gather operational intel on business processes and policies from multiple sources • Prepare periodical and ad-hoc reports using operational data • Develop semantic core to align data with business processes • Support operations team's work streams for data processing, analysis and reporting...

  • Big Data Engineer – Spark

    2 weeks ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & AnalyticsJob Description• Gather operational intel on business processes and policies from multiple sources• Prepare periodical and ad-hoc reports using operational data• Develop semantic core to align data with business processes• Support operations team's work streams for data processing, analysis and reporting•...

  • Data Engineer with Bigdata, Spark, Hive and Airflow | Basic knowledge working with Kubernetes IRC274087

    2 weeks ago

    Bengaluru, Karnataka, India GlobalLogic Full time US$ 1,04,000 - US$ 1,30,878 per year

    DescriptionData engineer with 8+ years of hands on experience working on Big Data PlatformsExperience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization.Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Andor Tech Full time

    Hiring Now: Data Engineering Roles at Andor Tech India Pvt Ltd We're looking for passionate and skilled Data Engineers to join our team and work with a leading retail-based MNC located in Manyata Tech Park, Bangalore. Open Positions: 1. Lead Data Engineer (8+ Yrs) / Sr. Data Engineer (5–8 Yrs) Skills Required: Hadoop, Hive, GCP, Python, Spark Elastic...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Andor Tech Full time

    Hiring Now: Data Engineering Roles at Andor Tech India Pvt Ltd We're looking for passionate and skilled Data Engineers to join our team and work with a leading retail-based MNC located in Manyata Tech Park, Bangalore. Open Positions:1. Lead Data Engineer (8+ Yrs) / Sr. Data Engineer (5–8 Yrs) Skills Required:Hadoop, Hive, GCP, Python, SparkElastic Search...

  • CAW Studios

    3 weeks ago

    Bengaluru, Karnataka, India CAW Studios Pvt Ltd Full time

    Job Description : We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The right...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    About the Organization-Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals.We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...

  • Java Spark Developer

    2 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Primary Skill: Spark, Java programmingStrong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streamingHands-on experience in any one of the programming languages (Java, Scala)Good understanding of distributed programming concepts.Experience in optimizing Spark DAG, and Hive queries on TezExperience using tools like Git, Autosys,...

  • Big Data Engineers/Senior Engineers

    6 days ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    About the Organization- Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders...

Studios - Data Engineer - Hive/Spark

2 weeks ago

Bengaluru, Karnataka, India CAW Full time US$ 90,000 - US$ 1,20,000 per year

Job Description
We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data :

  • Create and maintain optimal data pipeline architecture.
  • Create and maintain events/streaming-based architecture/design.
  • Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Create data tools for analytics and data scientist team members that assist them in building

and optimizing our product into an innovative industry leader.

  • Work with data scientists to strive for greater functionality in our data systems.

Requirements

  • We are looking for a candidate with 2+ years of experience in a Data Engineer role.
  • Experience with big data tools : HDFS/S3 Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools : Azkaban, Luigi, Airflow, etc.
  • Experience with AWS /GCP cloud services.
  • Experience with stream-processing systems : Spark-Streaming/Flink, etc.
  • Experience with object-oriented/object function scripting languages : Java, Scala, etc.
  • Experience building and optimizing big data pipelines, architectures, and data sets.
  • Strong analytic skills related to working with structured/unstructured datasets.
  • Build processes supporting data transformation, data structures, dimensional modeling,

metadata, dependency, schema registration/evolution, and workload management.

  • Working knowledge of message queuing, stream processing, and highly scalable big data data

stores.

  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Have a few weekend side projects up on GitHub.
  • Have contributed to an open-source project.
  • Have worked at a product company.
  • Have a working knowledge of a backend programming language.

)