Data Engineering Lead

2 weeks ago

Hyderabad, Telangana, India Kanerika Software Full time

Databricks Lead

About Kanerika

Who we are.

Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Confounded by Warton Business School Aluminous, our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data. We leverage cutting-edge technologies and industry best practices to deliver custom solutions that help organizations optimize their operations, enhance customer experiences, and drive growth.

Awards and Recognitions

Kanerika has won several awards over the years, including:

· Best Place to Work 2022 by Great Place to Work

· Top 10 Most Recommended RPA Start-Ups in 2022 by RPA Today

· NASSCOM Emerge 50 Award in 2014

· Frost & Sullivan India 2021 Technology Innovation Award for its Kompas composable solution architecture.

· Kanerika has also been recognized for its commitment to customer privacy and data security, having achieved ISO 27701, SOC2, and GDPR compliances.

Working for us

Kanerika is rated 4.5/5 on Glassdoor, for many good reasons. We truly value our employees' growth, well-being, and diversity, and people's experiences bear this out. At Kanerika, we offer a host of enticing benefits that create an environment where you can thrive both personally and professionally. From our inclusive hiring practices and mandatory training on creating a safe work environment to our flexible working hours and generous parental leave, we prioritize the well-being and success of our employees. Our commitment to professional development is evident through our mentorship programs, job training initiatives, and support for professional certifications. Additionally, our company-sponsored outings and various time-off benefits ensure a healthy work-life balance. Join us at Kanerika and become part of a vibrant and diverse community where your talents are recognized, your growth is nurtured, and your contributions make a real impact. See the benefits section below for the perks you'll get while working for Kanerika.

Role

This position will be engaged in design and deploy of large-scale data processing frameworks and pipelines on Databricks to support enterprise-wide BI and data science initiatives. It will also provide user training and data coaching for effective Databricks usage.


Locations: We are located at Austin (USA), Singapore, Gurugram (India), Ahmedabad (India) and Hyderabad (India).
Job Location – Hyderabad, Indore, Ahmadabad, Pune, Gurgaon

We are looking for you

Are you passionate about leveraging data to drive business insights and innovation? Do you thrive in a dynamic, collaborative environment where you can contribute your expertise to building scalable data solutions? Data Bricks is seeking a talented Data Engineer to join our team and play a pivotal role in designing and implementing data pipelines and infrastructure for our cloud-based analytics platform.



Requirements

What you will do

· Create ML-Ops frameworks for model development, training, deployment, and monitoring.
· Optimize Databricks clusters for performance, scalability, and resource efficiency.
· Monitor cluster health, performance metrics, and resource usage, adjusting cluster sizes as needed.
· Design efficient data processing systems and pipelines using Databricks, APIs, and other cloud services.
· Act as the Databricks expert and uphold platform standards.
· Collaborate with Data and Platform architects on defining the product roadmap.
· Build and maintain scalable infrastructure on cloud platforms such as AWS, Azure, or Google Cloud to support data processing and analytics workloads.
· Implement data governance best practices to ensure data quality, reliability, and security throughout the data lifecycle.
· Monitor and troubleshoot data pipelines to identify and resolve performance bottlenecks, data integrity issues, and other operational challenges.

What you'll bring

· Bachelor's degree in computer science or related field.
· 7+ years of IT experience, including 5+ years in Databricks development and administration, Spark, and cloud platforms (preferably Azure).
· Proficiency in Databricks admin and development, with expertise in Resource and Performance Management.
· Expertise in test automation, continuous integration, Docker, GitHub, Jenkins, and Unix/Linux.
· Leadership in large project initiatives, willingness to mentor, and support for team members from different time zones.

You will have advantage if you bring -

· Experience with Kafka and Spark, and strong in Python and Pyspark.
· Hands-on experience in machine learning pipelines and scripting languages.
· Familiarity with Java, Python, SQL/NoSQL databases, and Big Data tools.
· Passion for new tech, continuous improvement, and collaborative problem-solving.Proactive, strong work ethic, and team player

Benefits


Employee Benefits

1. Culture:

· Open Door Policy: Encourages open communication and accessibility to management.

· Open Office Floor Plan: Fosters a collaborative and interactive work environment.

· Flexible Working Hours: Allows employees to have flexibility in their work schedules.

· Employee Referral Bonus: Rewards employees for referring qualified candidates.

· Appraisal Process Twice a Year: Provides regular performance evaluations and feedback.

2. Inclusivity and Diversity:

· Hiring practices that promote diversity: Ensures a diverse and inclusive workforce.

· Mandatory POSH training: Promotes a safe and respectful work environment.

3. Health Insurance and Wellness Benefits:

· GMC and Term Insurance: Offers medical coverage and financial protection.

· Health Insurance: Provides coverage for medical expenses.

· Disability Insurance: Offers financial support in case of disability.

4. Child Care & Parental Leave Benefits:

· Company-sponsored family events: Creates opportunities for employees and their families to bond.

· Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child.

· Family Medical Leave: Offers leave for employees to take care of family members' medical needs.

5. Perks and Time-Off Benefits:

· Company-sponsored outings: Organizes recreational activities for employees.

· Gratuity: Provides a monetary benefit as a token of appreciation.

· Provident Fund: Helps employees save for retirement.

· Generous PTO: Offers more than the industry standard for paid time off.

· Paid sick days: Allows employees to take paid time off when they are unwell.

· Paid holidays: Gives employees paid time off for designated holidays.

· Bereavement Leave: Provides time off for employees to grieve the loss of a loved one.

6. Professional Development Benefits:

· L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development.

· Mentorship Program: Offers guidance and support from experienced professionals.

· Job Training: Provides training to enhance job-related skills.

· Professional Certification Reimbursements: Assists employees in obtaining professional certifications.

· Promote from Within: Encourages internal growth and advancement opportunities.

  • Big Data Engineer, Data Modeling

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Modeling

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Analysis

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at , I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing product...

  • Data Lead

    5 days ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Lead – SAP Sales and Distribution to join our team in [[Hyderabad]], [[Telangana]], [[India]].8+ of Overall experience...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). "Data Engineer...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in hyderabad, Telangana (IN-TG), India (IN).Who we...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:277204NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Once You Are...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Engineer Responsibilities-Create...

  • Data Engineering Lead

    2 weeks ago

    Hyderabad, Telangana, India Chryselys Full time

    Job Description:As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding of...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID:279798NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in hyderabad, Telangana (IN-TG), India (IN).Who we are:NTT...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). At...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in hyderabad, Telangana (IN-TG), India (IN).Who we are: NTT DATA...

  • Tableau Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:284210NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Tableau Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...

  • Tableau Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Tableau Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Engineer...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Position Overview ...

  • Digital Engineering Lead Engineer

    15 hours ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Preferred...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Foundation AI Full time

    Designation : Lead Data Engineer (Individual Contributor)Reporting to : Sr Tech LeadKey Responsibilities : Architect and Design Data Systems : Design and develop scalable data pipelines and systems to manage large volumes of structured and unstructured data. Data Pipeline Development : Develop scalable endtoend ETL (Extract, Transform, Load) data pipelines...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Foundation AI Full time

    Designation : Lead Data Engineer (Individual Contributor)Reporting to : Sr Tech LeadKey Responsibilities : Architect and Design Data Systems : Design and develop scalable data pipelines and systems to manage large volumes of structured and unstructured data. Data Pipeline Development : Develop scalable endtoend ETL (Extract, Transform, Load) data pipelines...