Databricks Engineer with Advanced Analytics Expertise

4 days ago


Bengaluru, Karnataka, India Tredence Inc. Full time
Job Description
At Tredence Inc., we're seeking a skilled Databricks Engineer with Advanced Analytics Expertise to join our team. This role involves developing modern data warehouse solutions using Databricks and AWS/Azure Stack, collaborating with DW/BI leads to understand new ETL pipeline development requirements, and working with business stakeholders to understand reporting needs and develop data models to fulfill those needs.

About the Role
This is an exciting opportunity for experienced professionals in data engineering and analytics to take their skills to the next level. As a Databricks Engineer, you'll be responsible for designing, implementing, and maintaining large-scale data pipelines using Databricks, Apache Spark, and other relevant technologies. You'll also collaborate with cross-functional teams to identify opportunities for process improvements and implement innovative solutions that drive business value.

Responsibilities
  • Developing data warehousing and data engineering solutions using Databricks and AWS/Azure Stack
  • Collaborating with DW/BI leads to understand new ETL pipeline development requirements
  • Working with business stakeholders to understand reporting needs and develop data models to fulfill those needs
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Orchestrating the data pipelines in scheduler via Airflow

Requirements
  • Bachelor's and/or master's degree in computer science or equivalent experience
  • Total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects
  • Deep understanding of Star and Snowflake dimensional modelling
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Hands-on experience in SQL, Python and Spark (Py Spark)
  • Candidate must have experience in AWS/Azure stack
  • Desirable to have ETL with batch and streaming (Kinesis)
  • Experience in building ETL/data warehouse transformation processes
  • Experience with Apache Kafka for use with streaming data/event-based data
  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational/NoSQL data repositories (incl. Mongo DB, Cassandra, Neo4 J)
  • Experience working with structured and unstructured data including imaging & geospatial data
  • Experience working in a Dev/Ops environment with tools such as Terraform, Circle CI, GIT
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable)
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
  • Should have experience working in Agile methodology
  • Strong verbal and written communication skills
  • Strong analytical and problem-solving skills with a high attention to detail

Benefits

As a valued member of our team, you can expect competitive compensation, benefits packages, career growth opportunities, and a collaborative work environment that fosters innovation, creativity, and excellence. We are committed to helping you grow professionally and personally.

Our salary package is estimated to be ₹1,200,000 - ₹2,400,000 per annum based on your qualifications, experience, and location within India. This range may vary depending on individual circumstances. Please note that this information serves only as a guideline, and actual compensation may differ accordingly.



  • Bengaluru, Karnataka, India Quantzig Full time

    About Quantzig:We are a global analytics and advisory firm driven by high-performance champions who excel in end-to-end advanced analytics, visual storyboarding, Machine Learning, and data engineering solutions.Why Choose Us?We offer a dynamic work environment that encourages growth, teamwork, and innovation. Our team is built on strong business and...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Welcome to this exciting opportunity at Tata Consultancy Services. We are seeking a highly skilled Cloud Data Engineer with expertise in advanced analytics.As a key member of our team, you will be responsible for designing and developing efficient data pipelines that integrate various data sources and transform raw data into actionable insights.The ideal...


  • Bengaluru, Karnataka, India GyanSys Inc. Full time

    We are seeking a highly skilled Databricks Engineer to lead our data migration efforts on the Azure cloud platform.With 6-8 years of experience in Python, SQL, and big data technologies, you will migrate on-premises Spark and Impala/Hive scripts to Databricks, transforming ETL pipelines to optimize data infrastructure.A strong background in data migration...


  • Bengaluru, Karnataka, India Visionyle Solutions Full time

    Job OverviewVisionyle Solutions seeks a skilled Databricks Cloud Engineer to join our team. This role involves designing, developing, and implementing advanced data engineering solutions on cloud platforms like AWS, Azure, or GCP.ResponsibilitiesAnalyze data sources and design strategies for populating data lakes and data warehouses.Develop, optimize, and...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description:LTIMindtree is seeking a Senior ML Engineer to operationalize machine learning workflows driving dynamic pricing and personalized consumer experiences. This position focuses on building robust ML infrastructure, frameworks, and orchestration pipelines.Key Responsibilities:Develop scalable ML infrastructure on Databricks leveraging Unity...


  • Bengaluru, Karnataka, India Quantzig Full time

    About Quantzig:As a leading global analytics and advisory firm, we deliver end-to-end advanced analytics, machine learning, and data engineering solutions to drive business growth. Our team of experts has a strong track record of assisting clients across the globe with prudent decision making.We are seeking a highly skilled Data Engineer with 6-8 years of...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Job Title: Senior Data Architect with Databricks ExpertiseAt Tredence Inc., we are seeking an experienced data architect to lead the design and implementation of our modern data warehouse solutions using Databricks and AWS/Azure Stack.We require a professional with 6+ years of IT experience and 3+ years' experience in Data Warehouse/ETL projects who can...


  • Bengaluru, Karnataka, India Quantzig Full time

    Unlock Business Growth with QuantzigWe are a global analytics and advisory firm seeking a Senior Data Engineer to join our team. With offices in the US, UK, Canada, China, and India, we have assisted clients worldwide with end-to-end advanced analytics, visual storyboarding, Machine Learning, and data engineering solutions.About Us:We are a rapidly growing...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job DescriptionWe are seeking an experienced Data Scientist to join our team as an Azure Data Engineer (Databricks). This role requires a strong understanding of cloud technology, data engineering, and programming skills in Python, SQL, and SPARK.Key ResponsibilitiesDesign and develop scalable data pipelines using Databricks and Azure services.Analyze and...


  • Bengaluru, Karnataka, India Quantzig Full time

    At Quantzig, we are seeking a highly skilled Databricks Migration Expert to join our team of data engineers. With a strong background in big data technologies and cloud platforms, this role requires excellent problem-solving skills and the ability to work independently on complex data migration tasks.About UsWe are a global analytics and advisory firm with...


  • Bengaluru, Karnataka, India Tiger Analytics Full time

    About the RoleWe are seeking an experienced Program Lead - Technology Consulting to join our team at Tiger Analytics. As a key member of our team, you will be responsible for driving problem discovery, scoping, program management, delivery, and ensuring the overall success of the program.This role involves a combination of hands-on contribution, customer...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Unlock the Power of Data ScienceTredence Inc., a leading provider of business analytics and data science solutions, is seeking an experienced Senior Data Architect to lead our Databricks practice. As a key member of our team, you will be responsible for designing and implementing modern data warehouse solutions using Databricks and AWS/Azure Stack.**About...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services is a leading IT consulting and business solutions organization that has been at the forefront of innovation.Salary: $140,000 - $180,000 per year, depending on experience and qualifications.Job DescriptionWe are seeking an experienced DataBricks ML Architect to join our team. As a key member of our data engineering...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    We are seeking a highly skilled Senior Azure Databricks Engineer to join our team at Tata Consultancy Services. This role offers a unique opportunity to leverage your expertise in designing and developing innovative data pipelines using Microsoft Azure services.The ideal candidate will have 5-9 years of experience in senior data engineering roles, with a...


  • Bengaluru, Karnataka, India HTC Global Services Full time

    Job OverviewWe are seeking an experienced Advanced Analytics Engineer to join our team at HTC Global Services. This role requires a strong background in analytics engineering, data modeling, and data transformation using GCP services. As an Advanced Analytics Engineer, you will be responsible for designing, developing, and maintaining scalable data...


  • Bengaluru, Karnataka, India Neuron7 Full time

    About Neuron7.aiWe are a rapidly growing AI-first SaaS company focused on creating a category-defining service intelligence product. Our mission is to enhance service decision-making through advanced AI technology, and we are dedicated to delivering excellence in all aspects of our work.What We Offer:Competitive salary ($150,000 - $180,000) and equity....


  • Bengaluru, Karnataka, India Quantzig Full time

    About QuantzigWe are a global analytics and advisory firm with a presence in the US, UK, Canada, China, and India. Our team has successfully assisted clients worldwide with end-to-end advanced analytics, data engineering solutions, and machine learning implementation for informed decision-making.We are a rapidly growing organization built and operated by...


  • Bengaluru, Karnataka, India Tiger Analytics Full time

    Unlock the Power of AI and Analytics with Tiger AnalyticsAbout UsTiger Analytics is a global leader in AI and analytics, empowering Fortune 1000 companies to solve their toughest challenges. With full-stack AI and analytics services & solutions, we help businesses achieve real outcomes and value at scale.We are on a mission to push the boundaries of what AI...


  • Bengaluru, Karnataka, India Quantzig Full time

    About QuantzigQuantzig is a global analytics and advisory firm with offices across the globe, serving clients from diverse industries. We have a proven track record of assisting our clients in implementing end-to-end advanced analytics, machine learning, and data engineering solutions for informed decision-making.Job OverviewWe are seeking an experienced...


  • Bengaluru, Karnataka, India Useful BI Corporation Full time

    **About the Role:**We are seeking a highly experienced Senior Cloud Engineer with advanced analytics skills to lead our cloud infrastructure team.This key position is responsible for delivering high-impact projects across financial and business intelligence domains, focusing on cloud-based solutions.The scope of this role includes designing, developing, and...