See more Collapse

Bigdata

4 weeks ago


Remote, India Ness Digital Engineering Full time

**Description**

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from various advantages like access to training and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

**What you'll do**:

- Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta lake
- Design & Develop “Transformations” aspects using the ELT framework to modernize the Ingestion pipelines and build data transformations at scale
- Work closely with other data teams & Data Science teams and participate in the development of Ingestion pipelines
- Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark
- Build and maintain a data environment for speed, accuracy, consistency, and ‘up’ time
- Work closely with other data teams & Data Science teams and participate in the development of Ingestion pipelines
- Ensure data governance principles are adopted, data quality checks and data lineage implemented in each hop of the data
- Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies
- Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards

**What you'll bring**:

- Should be in a position to handle issue resolution and provide direction to teams both technically and functionally
- Should be able to articulate and convert requirements into solutions.
- Experience With Machine Learning Libraries and Frameworks (TensorFlow, MLlib) is an added advantage
- Experience with development frameworks as well as data and integration technologies such as Informatica, Python, Scala
- Expert knowledge of Agile approaches to software development and able to put key Agile principles into practice to deliver solutions incrementally.
- Monitors industry trends and directions; develops and presents substantive technical recommendations to senior management
- Excellent analytical thinking, interpersonal, oral, and written communication skills with a strong ability to influence both IT and business partners
- Ability to prioritize and manage work to critical project timelines in a fast-paced environment
- Financial services industry experience

Desirable Skills:

- BE, MCA, or MS degree in Computer Science or Information Technology
- 8+ years of experience as a data engineer at an innovative organization
- 5+ years of hands-on experience implementing data lake systems using AWS/Azure cloud technologies such as S3, Databricks, Hive, Spark & Scala, Python, etc.
- Strong expertise (preferably 5 years) in SDLC cycle including stakeholder management, people management, risk management, strategic management, communication management

Not checking every single requirement?

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.


We have other current jobs related to this field that you can find below

  • SEO Expert

    1 week ago


    Remote, India Outsource Bigdata Full time

    May 28, 2024 **Aimleap**: **India (Remote)**: **Posted on May 28, 2024**: **AIMLEAP is Hiring**: **SEO Expert (B2B Review Platforms)** WFH**: Experience: 4 to 9 years Location: Work from Home/Bangalore/India CTC: Competitive, based on experience No of positions: 2 Employment time: Full time/Consulting Educational qualification: B tech/Business...

  • Sales Expert

    4 weeks ago


    Remote, India Outsource Bigdata Full time

    May 13, 2024 **Aimleap**: **India (Remote)**: **Posted on May 13, 2024**: **AIMLEAP is Hiring**: **Sales Expert (CRM Experience**) WFH**: Experience: 4 to 7 years Location: Work from Home/Bangalore/India CTC: 10 lacs to 15 lacs INR per annum No of positions: 2 Employment time: Full time/Consulting Educational qualification: Business Administration, Sales,...


  • Remote, India Outsource Bigdata Full time

    Jun 12, 2024 **Aimleap**: **India (Remote)**: **Posted on Jun 12, 2024**: **AIMLEAP is Hiring**: **LinkedIn Social Media Strategist (WFH)**: Experience: 5+ years Location: Work from Home/Bangalore CTC: 8 to 12 LPA Engagement model: Full time/Consulting No of positions: 2 Educational qualifications: MBA/Marketing Industry: IT-ITES Notice Period:...

  • CRM Zoho Expert

    3 weeks ago


    Remote, India Outsource Bigdata Full time

    Apr 19, 2024 Aimleap India (Remote) Posted on Apr 19, 2024 **AIMLEAP is Hiring**: CRM Zoho Expert (WFH) **Experience**: 4 to 7 years **Location**: Work from Home/Bangalore/India **CTC**: 10 lacs to 15 lacs INR per annum **No of positions**: 2 **Employment time**: Full time/Consulting **Educational qualification**: Engineering/CS/IT **Industry**:...


  • Remote, India Outsource Bigdata Full time

    **Digital Marketing Executive** Experience: 6 months to 2 Years Location: WFH/Bangalore, India No of positions: 2 Nos Industry: Digital Marketing / IT Employment Type: Permanent Job, Full Time Educational Qualification: MBA / B.Tech. / B.E / MCA **Salary**: 1.5 lacs to 3 lacs INR Per Annum **Notice Period: Immediate** **What we are looking for**: -...

  • Scrum Master

    3 weeks ago


    Remote, India Outsource Bigdata Full time

    Role: Business Analysts/Testing/Scrum Master Prior Role/Experience**:Software Development/Testing/BA** Education: Degree in Computer Science or equal Experience: 3 to 6 years Work Location: WFH/Bangalore Work Time: 2: 30 pm to 11: 30 pm IST **Salary**: 4.5 lacs to 7 lacs INR per annum **Responsibilities**: - Work closely with stakeholders to understand...

  • SEO Executive Trainee

    3 weeks ago


    Remote, India Outsource Bigdata Full time

    **SEO Executive Trainee** Experience: Fresher (0-2 Year) Location: Any Location/Bangalore, India No of positions: 2 Nos Industry: Digital Marketing / IT Employment Type: Trainee/Full Time Educational Qualification: Any Degree **Salary**: 10K to 15K INR Per Month **Notice Period: Immediate** **JOB DESCRIPTION**: - Trained or experienced on SEO, backlink...

  • Figma Ui/ux Designer

    3 weeks ago


    Remote, India Outsource Bigdata Full time

    Jan 24, 2024 Aimleap India (Remote) Posted on Jan 24, 2023 **AIMLEAP is Hiring**: Figma UI/UX Designer (2 to 5 Year) **Location**: Remote/WFH **CTC**: 5 Lacs to 9 Lacs INR PA **Employment Type**: Full time/Consultant **Requirements**: Hands-on experience in Figma UI/UX design, with a focus on SaaS products. **Portfolio**: Showcase a diverse...


  • Remote, India Outsource Bigdata Full time

    **Assistant Digital Marketing Executive (WFH) - 6 months to 3 Years** Experience: 6 months to 3 Years Location: Work from Home/Bangalore No of positions: 2 Nos Industry: Digital Marketing Educational Qualification: Any degree/Digital Marketing **Salary**: 1.5 to 2 lacs INR per annum Notice Period**:Immediate** **Required Skills**: - Trained or experienced...

  • Web Scraping Expert

    4 weeks ago


    Remote, India Outsource Bigdata Full time

    Jun 6, 2024 **Aimleap**: **India (Remote)**: **Posted on Jun 06, 2024**: **AIMLEAP is Hiring**: **Web Scraping Expert (Scrapy & Python) WFH**: Experience: 3 to 5 years Location: Work from Home/Bangalore/India **Salary**: 3 Lacs to 7 Lacs INR PA No of positions: 4 Employment time: Full time Educational qualification: CS/IT/Engineering Industry:...


  • Remote, India Outsource Bigdata Full time

    Experience: 6 months to 1 Year (Prior experience is must) Location: Any Location/Remote/Bangalore, India No of positions: 2 Nos Industry: Data Engineering/SaaS Product Educational Qualification: MBA Duration: 8 months Stipend: 15K to 25K INR per month Notice Period**:Immediate** Here is what we are looking for: - Minimum 6 months **prior experience in...


  • Remote, India Outsource Bigdata Full time

    Feb 15, 2024 Aimleap India (Remote) Posted on Feb 15, 2024 **AIMLEAP is Hiring**: Appointment Liaison Executive (US Accent/British Accent) - WFH **Experience**: 0.5 to 8 Years **Time**: US Shift (6 pm to 3 am IST) **Location**: Work from Home/Anywhere **Industry**: Call center/IT/ITES **Job Type**: Full time **Educational Qualification**: +2/...

  • Account Executive

    2 weeks ago


    Remote, India BigData Dimension Inc Full time

    Job Title: Account Executive Job Category: Full-Time **REQUIREMENTS**: Bachelor’s degree in accounting or equivalent experience Experience 3+ years of experience and demonstrated success in accounting and bookkeeping functions **RESPONSIBILITIES**: - Responsible for all aspects of data entry and maintenance of the QuickBooks accounting software...


  • Remote, India BigData Dimension Inc Full time

    **Position : Azure Data Architect with H1-B Visa** **Location : (Remote )** **Job Type: Only Full-time** **Visa Status: Only H1B** **Mandatory Skills: Azure Data Factory, Databricks, Azure Cloud** **- **Expert in Azure Data Factory implementations and designing solutions - Exposure to Azure Service Bus, Azure logic Apps and Azure Functions - Experience in...

  • Course

    2 weeks ago


    Remote, India TSAR IT PVT LTD Full time

    Do you want to learn new technology Courses? **Our Courses**: - Full Stack Java Developer - Python - React Js - AWS - SalesForce - Azure - BigData - Cloud - Data Science - Web Development - PHP - SAP - etc **50% Off for All Courses** - **We are providing Online classes** **Key-Benefits** - Top Industry Experts as Trainers - Intensive Hands-on Training -...


  • Remote, India Precisely Full time

    Precisely is the leader in data integrity. We empower businesses to make more confident decisions based on trusted data through a unique combination of software, data enrichment products and strategic services. What does this mean to you? For starters, it means joining a company focused on delivering outstanding innovation and support that helps customers...


  • Remote, India Precisely Full time

    Precisely is the leader in data integrity. We empower businesses to make more confident decisions based on trusted data through a unique combination of software, data enrichment products and strategic services. What does this mean to you? For starters, it means joining a company focused on delivering outstanding innovation and support that helps customers...