Big Data Engineer

4 weeks ago

Bengaluru, India Tiger Analytics Full time

Location- Chennai, Bangalore & Hyderabad
As an Azure BDE Senior Data Engineer, you will
the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,
with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and standards.
collaborate with a team of data engineers in designing frameworks, pipelines for ingestion, integration, data quality, deriving metrics for serving layer.
requirements analysis, design, delegating work, creating code templates, troubleshooting, performing code review and deployments.
with a team of business domain experts, data scientists and application developers to develop solutions.
and learn new technologies for creative business problem solving and mentor a team of Data Engineers.
Skillset expectation:
hands-on experience in implementing data lake using technologies such as Databricks Spark, Data Factory, Azure Data Lake
programming skills in Python/Scala, Pyspark, SQL
in implementing complex design for data ingestion, data transformation, handling batch, micro-batch, streaming pipelines, event-driven processing, deriving metrics, applying data harmonization, building data marts and aggregate layers.
to understand data (attributes, metrics), relate to reporting/analytical use-cases of various business functions at a high-level and include those nuances in the design for scalability, availability.
in analyzing code, modularized design, coding best practices, code review, test strategies, code review, troubleshooting and performance optimization.
with Architect in implementing governance layer to manage data quality, data catalog, data lineage and data security.
in setting up consumption layer and serving data assets in a secure way for BI reporting, Adhoc analytics, DS/ML use-cases and external users.
to upskill, experiment quickly for creating POCs / Prototypes when evaluating new features, design patterns, adopting open-source frameworks and building custom solution.
to integrate DevOps, CI-CD branching strategies, deployments for code components developed in Data factory, Databricks, Functions etc.,
6+years of technical experience with at least 4 years on MS Azure and Big data technologies.

  • Big Data Engineer

    1 week ago

    Bengaluru, India Awign Expert Full time

    This is a remote position.Job Title: Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    2 months ago

    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • big data engineer

    4 days ago

    Bengaluru, Karnataka, India Techno Wise Full time

    Apply for BIG DATA ENGINEER, Techno Wise in Bengaluru/ Bangalore ,Mumbai ,Pune for 4 - 8 Year of Experience on

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELMid-level roleEMPLOYEE ROLEIndividual ContributorResponsibilities:Build and maintain cutting-edge data platform and data processing pipelines.Challenge the status quo by innovating and creating a cost-effective big data platform.Collaborate across teams to develop AI-based experiences.Establish a culture of scientific processes and customer...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELMid-level roleEMPLOYEE ROLEIndividual ContributorResponsibilities:Build and maintain cutting-edge data platform and data processing pipelines.Challenge the status quo by innovating and creating a cost-effective big data platform.Collaborate across teams to develop AI-based experiences.Establish a culture of scientific processes and customer...

  • Big Data Engineer

    3 days ago

    Bengaluru, India Evnek Technologies Pvt Ltd Full time

    This is a remote position.Duration:6 MonthLocation:RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 YearsResponsibilitiesCreate and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, India Global Pharma Tek Full time

    Auto req IDBRTitleBig Data EngineerYour Role and ResponsibilitiesUnderstand a data warehousing solution and able to work independently in such an environmentResponsible in Project development and delivery experience of a few good size projectsPosting CountryIndiaState / ProvinceHaryānaCity / Township / VillageGurgaonTravel RequiredUp to % or day a...

  • Senior Big Data Engineer

    2 weeks ago

    Bengaluru, India DATASPARK HIRE Full time

    We are seeking a talented BigData Engineer with 2 to 5 years of experience tojoin our data engineering team. The successful candidate will playa crucial role in designing building and maintaining our big datainfrastructure and pipelines. You will work with large datasetsensuring data accessibility reliability and efficiency to supportdatadriven...

  • Senior Big Data Engineer

    1 week ago

    Bengaluru, India DATASPARK HIRE Full time

    We are seeking a talented BigData Engineer with 2 to 5 years of experience tojoin our data engineering team. The successful candidate will playa crucial role in designing building and maintaining our big datainfrastructure and pipelines. You will work with large datasetsensuring data accessibility reliability and efficiency to supportdatadriven...

  • Big Data Engineer

    2 months ago

    Bengaluru, India Hexaware Technologies Full time

    DescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...

  • Big Data Engineer

    2 months ago

    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Big Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELP50EMPLOYEE ROLEIndividual ContributorP50 (ESDEP50) Big Data Engineer What You'll Do Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 22, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...