Data Engineer

2 months ago

Mysore division, India Incedo Inc. Full time

Data engineer – Big Data

Incedo is a US-based consulting, data science, and technology services firm with over 2,000 people helping clients from our six offices across the US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering, and life science & healthcare industries.


Working at Incedo will provide you an opportunity to work with industry-leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.

Role Description: Data Engineer – Big Data

The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with minor supervision. The person should be a self-motivated person with a passion for problem-solving and continuous learning.

Designation:

Lead Data Engineer : 8-12 Years


Primary Skills: Azure Cloud, Azure Data Factory, ADLS GEN2, Spark, PySpark, Scala, Hive, Databricks, Python

Secondary Skills: Azure Synapse, ETL, Shell Script, Unix, Azure functions, Git


Role and responsibilities

Strong technical, analytical, and problem-solving skills

Strong organizational skills, with the ability to work autonomously as well as in a team-based environment

Design and implement efficient data models to support analytical and operational use cases.

Work closely with business stakeholders to understand their data requirements and translate them into technical specifications.

Design, develop, and maintain scalable data pipelines and architectures using Azure and Databricks.

Conduct data profiling, analysis, and validation to ensure data quality and consistency.

Implement data processing workflows using Spark and Python, ensuring data integrity, quality, and performance.

Work independently to troubleshoot, optimize, and debug complex data engineering issues.

Develop and enforce best practices for data governance, security, and compliance.

Data pipeline Monitoring development & support (operations)

Document technical designs, processes, and solutions to ensure knowledge transfer and maintain comprehensive project documentation.

Provide mentorship and guidance on best practices for data modeling and engineering to team members when necessary.


Technical skills requirements

The candidate must demonstrate proficiency in,

Big data processing and extraction

Ability to own and deliver on large, multi-faceted projects

Fluency in complex SQL and experience with RDBMSs

(Azure Cloud, Spark, PySpark, Scala, Python, Hive, NoSql DBs)

Experience designing and building big data pipelines

Experience working on large-scale, distributed systems

Hands-on Experience working on Azure Cloud services like (Azure Data Factory, Databricks, ADLS, Azure HD Insights,Azure Synapse, Azure Data Warehouse)

Strong hands-on experience in programming languages like PySpark, and Scala with Spark, Python, Shell Script

Exposure to various ETL and Business Intelligence tools

Solid grounding in Agile methodologies

Experience with git and other source control systems

Strong communication and presentation skills


Nice-to-have skills

Certification in Hadoop/Big Data – Hortonworks/Cloudera

Azure Cloud certification

Unix or Shell scripting

Strong delivery background across the delivery of high-value, business-facing technical projects in major organizations

Experience in managing client delivery teams, ideally coming from a Data Engineering / Data Science environment


Qualifications

  • B.Tech./M.Tech. or BCA/MCA degree from a reputed university


We are an Equal Opportunity Employer

We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

  • Data Engineer

    7 days ago

    Mysore division, India Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Staff Software Engineer

    2 weeks ago

    Mysore division, India HuntingCube Recruitment Solutions Full time

    Sr. Staff Software EngineerIncreasingly complex modern applications demand increasingly flexible and powerful tools in order to empower engineers to identify, resolve, investigate, and prevent issues and outages.This role targets a candidate with expertise in the development of large-scale tools for monitoring and troubleshooting of production software...

  • Senior Specialist- Data Engineer

    1 month ago

    Mysore division, India Sun Life Full time

    PRINCIPAL RESPONSIBILITIESSupport drafting, reviewing, and negotiating legal contracts/agreements/documents to make sure that it is in organization’s interest.Support in the preparation of other company related documentations.Hands on in maintaining the contract lifecycle management process over tools.Assistance in the Regulatory Compliance Assessment for...

  • Azure Cloud Engineer

    2 weeks ago

    Mysore division, India System Soft Technologies Full time

    Title: Azure Cloud Engineer100% REMOTEPOSITION SUMMARY:As an Azure Cloud Engineer, you will be responsible for implementing and maintaining our business systems and applications in the Microsoft Azure cloud. You will collaborate closely with other enterprise teams to ensure that systems and users are operating optimally in a hybrid environment. This role...

  • Geo Hazard Engineer

    2 weeks ago

    Mysore division, India Quest Global Full time

    Recruiting for below rolesGeo Hazard SpecialistGeo Technical EngineerSenior Foundation Engineer We are accepting Job Applications on EmailDirect Applications Accepted : - Email : Dipali.Jajoo@quest-global.com;sunil.chandran@quest-global.comGeo Hazard SpecialistKey Accountabilities/ Responsibilities:• Provide geohazards expertise across offshore wind...

  • Manager, Engineering

    2 weeks ago

    Mysore division, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for...

  • Site Reliability Engineer

    3 weeks ago

    Mysore division, India HuntingCube Recruitment Solutions Full time

    PHONEPELocation: BangaloreAbout PhonePe PhonePe is India’s leading digital payments platform with 350 million+ registered users. Using PhonePe, users can send and receive money, recharge mobile, DTH, data cards, pay at stores, make utility payments, buy gold, and make investments. PhonePe went live for customers in August 2016 and was the first non-banking...

  • Data Warehouse Engineer

    3 months ago

    Delhi Division, India Tek Experts Full time

    Overview We’re searching for a Data Warehouse Engineer with a proven track record of developing Business Intelligence solutions to drive key outcomes. The role is responsible for different layers of the data hierarchy - including database design, data collection and storage techniques, to a deep understanding of data transformation tools and...

  • Fixed Wireless Access Software Architect

    3 weeks ago

    Mysore division, India Airties Full time

    About AirtiesAt Airties we are on a mission to empower broadband operators to deliver a better-connected home experience for their subscribers. We have an exciting story to tell, and we want you to help us tell it!Airties offers broadband operators advanced Wi-Fi solutions and services to allow them bring an improved user experience for their subscribers....

  • GCP Architect

    1 week ago

    Mysore division, India Tech Mahindra Full time

    Hi All,Greetings from Tech Mahindra.We are hiring GCP Architects for Chennai Location. JD is below. If you are interested kindly apply with your updated profile GCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect)• 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica,...

  • Data Entry Executive

    3 months ago

    Mysore, India PAMS ENGINEERING, MYSORE Full time

    Company Name: PAMS ENGINEERING Company Address: No. 72/A2, Hootagalli Industrial Area, Mysore - 570018 Designation: Data Entry Executive Essential Qualification: Any Degree SKILLS - Fast typing skills; Knowledge of touch typing system is strongly preferred - Excellent knowledge of word processing tools and spreadsheets (MS Office Word, Excel etc.) -...

  • Quality Analyst II

    2 weeks ago

    Mysore division, India lululemon Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Data Engineer

    3 months ago

    Delhi Division, India USIL Technologies Full time

    Title : Data Engineer for hospitality AnalyticsLocation : New DelhiNote : Looking for candidates from Hospitality or Airline domain- : 5-10 yearsJob Description :Job Summary: We are seeking a highly skilled Data Engineer to join our Data Analytics team. The ideal candidate will have extensive experience with Microsoft Fabric, Azure Data Factory, Data Lake,...

  • React.js Developer

    2 weeks ago

    Mysore division, India Scalaix Full time

    Note: if you had applied to our earlier posting, we encourage you to reapply. There were some technical issues with the old posting and we may not be able to respond to all applicants. Company DescriptionScalaix is a technology company that specializes in building scalable AI applications. Our platform offers broker platform that supports multiple LLM...

  • Project Manager

    1 month ago

    Mysore division, India Spinach Experience Design Full time

    About the Company:Spinach Experience Design is a leading Mumbai-based UI UX product design and development company that partners with an entire gamut of clients ranging from global Fortune 500 companies, and listed MNCs to brave new funded or 0-1 startups. Our cutting-edge work features across 8 world markets showcasing our expertise across diverse sectors...

  • Product Management Specialist

    7 days ago

    Mysore division, India Andor Tech Full time

    Job Title: Product ManagerLocation: Pune (Hadapsar)Client Domain: AerospaceExperience: 2+ YearsNotice: Looking for Immediate joiner OR someone who can join in 15days. Key Responsibilities:Lead product management activities within the aerospace domain, focusing on pricing strategies, product lifecycle management, and market analysis.Collaborate with...

  • Content Strategist

    2 weeks ago

    Mysore division, India Springboard Digital Full time

    Roles and Responsibilities :Ability to do market research and capture relevant data points.Ability to write concise, compelling copy. Write creative advertising copy for social media ad campaigns (Captions for Social Media Posters, Scripts for Video Ad etc.)Translate marketing strategies into creative narration. Ideate and execute campaigns that are unique...

  • Prinicipal Architect

    2 months ago

    Mysore division, India HGS - Hinduja Global Solutions Full time

    At HGS Digital, our vision is to be the globally preferred digital transformation partner for our clients, creating value in their business through rigorous innovation at scale. We are an expert team of 500+ leading strategic thinkers, digital marketing and creative masters, data analysts, software engineers, and process optimization specialists with an...

  • Xeno - Senior Data Engineer - ETL Tools

    1 week ago

    Delhi Division, India Xeno Private Limited Full time

    About Xeno :- Xeno's mission is to enable brands to delight their customers at scale.- Imagine if a brand has 3 million existing customers, with Xeno they can create 3 million campaigns specific to each & every individual customer over SMS, email, Facebook & Instagram.- On top of that, we're crazily focused on building the best company to work for...

  • Lead Data Engineer(Snowflake/DBT)

    3 months ago

    Delhi Division, India Tide Full time

    Job Title: - Lead Data EngineerLocation: - Delhi NCRAbout TideAt Tide, we are building a finance & admin platform designed to save small businesses time and money. We provide our members with business accounts and related banking services, but also a comprehensive set of connected administrative solutions from invoicing to accounting.Launched in 2017, Tide...