Databricks (Remote)

4 hours ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year


Roles & responsibilities

  • Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space
  • Collaborating with DW/BI leads to understanding new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Work with businesses to understand the need in the reporting layer and develop a data model to fulfill
  • reporting needs
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussion with client architects and team members
  • Orchestrate the data pipelines in the scheduler via Airflow
  • Qualification & experience
  • Bachelor's and/or master's degree in computer science or equivalent experience.
  • Must have a total of 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
  • Deep understanding of Star and Snowflake dimensional modeling.
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Should have hands-on experience in SQL, Python, and Spark (PySpark)
  • Candidate must have experience in AWS/ Azure stack
  • Desirable to have ETL with batch and streaming (Kinesis).
  • Experience in building ETL / data warehouse transformation processes
  • Experience with Apache Kafka for use with streaming data / event-based data
  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,
  • Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, and GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, an troubleshooting.
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing
  • concurrent projects
  • Should have experience working in Agile methodology.
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail. Mandatory Skills:
  • Python/ PySpark / Spark with Azure/ AWS Databricks

  • Azure Databricks Engineer

    2 days ago

    Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

     Position: Azure Databricks EngineerCompany: KrtrimaIQ Cognitive SolutionsLocation: Bangalore (Hybrid / Remote)Experience: 4–8 YearsCertifications: Microsoft Certified – Azure Data Engineer Associate (DP-203) (Mandatory)About KrtrimaIQ Cognitive Solutions:At KrtrimaIQ, we are a next-generation AI & Data Engineering company enabling enterprises...

  • Azure - Data Scientist (Remote)

    5 days ago

    Bengaluru, Karnataka, India 2cfa50f2-c82e-4f5e-bc91-fcb502b3f707 Full time ₹ 17,28,000 per year

    Location: Remote IndiaEmployment Type: Full-time Independent ContractorDuration: Open-ended contractShift: Starts between 12pm to 2pm IST (8 hours shift)Equipment: Company ProvidedRequirements:Proven experience in data pipeline design and development using Azure Data Factory, Synapse, or DatabricksStrong background in mathematics, probability, and...

  • Data Engineer(Python, Databricks, SQL, AWS)

    2 weeks ago

    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    SummaryWe are looking for a Data Engineer role. This role is strictly involved in the development of the product and does not involve access to Protected Health Information (PHI) & Personally Identifiable Information (PII) or any secured/confidential client data. The work is limited to application development & demo and does not include handling or...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Vikgol Technologies Private Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Remote Data Engineer - Azure DatabricksLocation: RemoteJob Type: Full-timeHiring 3 Data Engineers (Remote)Vikgol is looking for experienced Data Engineers to design, build, and maintain our cloud data infrastructure. This is a 100% remote, full-time position where you will work with cutting-edge technologies like Azure Databricks.Key...

  • Senior Professional Product Developer

    5 days ago

    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    SummaryAs a Python fullstake developer at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community's most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare's...

  • Senior Professional Product Developer

    5 days ago

    Bengaluru, Karnataka, India Gainwell Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    SummaryAs a Python fullstake developer at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community's most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare's...

  • Aws Data Engineer

    3 days ago

    Bengaluru, Karnataka, India BriskWin IT (BWIT) Full time ₹ 4,00,00,000 - ₹ 8,00,00,000 per year

    AWS Data EngineerDatabricks exp is very much mandatory with AWS services.Work Location - RemoteNotice Period: Immediate Joiner apply onlyExperience: 6years - 12yearsMust Have:5+ years of experience building and managing Data Lake Architecture on AWS Cloud3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS,...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India CAI Full time ₹ 7,00,000 - ₹ 14,00,000 per year

    Data EngineerReq number:R6646Employment type:Full timeWorksite flexibility:RemoteWho we areCAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Stellar Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Data EngineerRemote Work: RemoteDuration: 8 months contractJob OverviewWe are seeking a skilled Data Engineer with strong SQL expertise and a solid foundation in data warehousing concepts. The ideal candidate will have hands-on experience working with large-scale data environments and a keen understanding of performance optimization...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India CAI Full time ₹ 3,00,000 - ₹ 5,00,000 per year

    Data EngineerReq number:R6655Employment type:Full timeWorksite flexibility:RemoteWho we areCAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately...