Databricks (Remote)

1 day ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


Roles & responsibilities

  • Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space
  • Collaborating with DW/BI leads to understanding new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Work with businesses to understand the need in the reporting layer and develop a data model to fulfill
  • reporting needs
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussion with client architects and team members
  • Orchestrate the data pipelines in the scheduler via Airflow
  • Qualification & experience
  • Bachelor's and/or master's degree in computer science or equivalent experience.
  • Must have a total of 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
  • Deep understanding of Star and Snowflake dimensional modeling.
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Should have hands-on experience in SQL, Python, and Spark (PySpark)
  • Candidate must have experience in AWS/ Azure stack
  • Desirable to have ETL with batch and streaming (Kinesis).
  • Experience in building ETL / data warehouse transformation processes
  • Experience with Apache Kafka for use with streaming data / event-based data
  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,
  • Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, and GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, an troubleshooting.
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing
  • concurrent projects
  • Should have experience working in Agile methodology.
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail. Mandatory Skills:
  • Python/ PySpark / Spark with Azure/ AWS Databricks

  • Senior Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 1,20,000 - ₹ 3,60,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Software Engineer (Backend) P-926 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our...

  • Manager, Field Engineering

    3 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    FEQ326R270As a Manager, Field Engineering (Data & AI)  (Strategic Accounts, Data & AI) will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with the...

  • Azure Databricks Engineer

    3 days ago

    Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

     Position: Azure Databricks EngineerCompany: KrtrimaIQ Cognitive SolutionsLocation: Bangalore (Hybrid / Remote)Experience: 4–8 YearsCertifications: Microsoft Certified – Azure Data Engineer Associate (DP-203) (Mandatory)About KrtrimaIQ Cognitive Solutions:At KrtrimaIQ, we are a next-generation AI & Data Engineering company enabling enterprises...

  • Databricks Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Databricks Data Platform - ArchitectJob...

  • Azure Databricks Sr Engineer

    5 days ago

    Bengaluru, Karnataka, India AVE-Promagne Business Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Notice Period: Immediate to 30 Days (Preferred)Job Summary:We are seeking a skilled Azure Data Engineer to join our growing data team. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and SQL, and will contribute to designing and implementing scalable, secure, and high-performance data solutions on Microsoft...

  • Sr Data Engineer- Remote

    1 day ago

    Bengaluru, Karnataka, India Uplers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience: yearsSalary: INR / year (based on experience)Expected Notice Period: 7 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Hybrid (Bengaluru)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas)**(*Note: This is a requirement for one of Uplers' client - Beige Bananas)**What do you need for...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Vikgol Technologies Private Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Remote Data Engineer - Azure DatabricksLocation: RemoteJob Type: Full-timeHiring 3 Data Engineers (Remote)Vikgol is looking for experienced Data Engineers to design, build, and maintain our cloud data infrastructure. This is a 100% remote, full-time position where you will work with cutting-edge technologies like Azure Databricks.Key...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India CAI Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Data EngineerReq number:R6413Employment type:Full timeWorksite flexibility:RemoteWho we areCAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Stellar Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Data EngineerRemote Work: RemoteDuration: 8 months contractJob OverviewWe are seeking a skilled Data Engineer with strong SQL expertise and a solid foundation in data warehousing concepts. The ideal candidate will have hands-on experience working with large-scale data environments and a keen understanding of performance optimization...