Big Data Engineer

1 month ago

Bengaluru, India Zelus India Full time

Job Description :


- Design, develop, and maintain scalable and high-performance data processing applications using Apache Spark and Scala, leveraging distributed computing frameworks for processing large volumes of data.

- Data Ingestion and Transformation : Implement data ingestion pipelines to ingest data from various sources into Azure Data Lake Storage or Azure Blob Storage, and transform the data using Spark RDDs, DataFrames, and Datasets.

- Spark Development : Develop Spark applications using Scala programming language, utilizing Spark APIs for data manipulation, transformation, aggregation, and analysis

- Integrate Spark applications with other Azure services such as Azure Databricks, Azure Synapse Analytics, Azure HDInsight, and Azure SQL Database for end-to-end data processing and analytics workflows.

- Streaming Data Processing : Implement real-time data processing solutions using Spark Streaming or Azure Stream Analytics, enabling real-time insights and analytics on streaming data sources.

- Data Orchestration : Design and implement data orchestration workflows using Apache Airflow or Azure Data Factory to schedule and manage Spark jobs and data pipelines.

- Experience with cloud platforms, particularly Microsoft Azure, and familiarity with Azure services such as Azure Data Lake Storage, Azure Blob Storage, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory.

- Strong understanding of distributed computing principles and big data processing concepts, including data partitioning, parallel processing, and fault tolerance.

(ref:hirist.tech)

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....

  • Big Data Engineer

    1 month ago

    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELMid-level roleEMPLOYEE ROLEIndividual ContributorResponsibilities:Build and maintain cutting-edge data platform and data processing pipelines.Challenge the status quo by innovating and creating a cost-effective big data platform.Collaborate across teams to develop AI-based experiences.Establish a culture of scientific processes and customer...

  • Big Data Engineer

    5 days ago

    Bengaluru, India Global Pharma Tek Full time

    Auto req IDBRTitleBig Data EngineerYour Role and ResponsibilitiesUnderstand a data warehousing solution and able to work independently in such an environmentResponsible in Project development and delivery experience of a few good size projectsPosting CountryIndiaState / ProvinceHaryānaCity / Township / VillageGurgaonTravel RequiredUp to % or day a...

  • Big Data Engineer

    1 month ago

    Bengaluru, India Hexaware Technologies Full time

    DescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...

  • Big Data Engineer

    2 months ago

    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Big Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELP50EMPLOYEE ROLEIndividual ContributorP50 (ESDEP50) Big Data Engineer What You'll Do Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 22, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 23, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    6 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    6 days ago

    Bengaluru, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon Travel...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 19, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 23, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    7 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    6 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    4 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    2 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...