Azure Databricks Engineer

1 month ago


Anywhere in IndiaMultiple LocationsHyderabadBangalorePuneMumbaiChennai, IN BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

Position/Role : Azure data bricks with Pyspark/Spark/Python and SQL

Experience : 6-12 yrs

Location : Hyderabad/Bangalore/Pune/Mumbai/Chennai (Hybrid)

Job Overview :

Primary Skills : Databricks with Pyspark/Spark/ Python and SQL

Secondary skills : ADF

Job Description :

  • 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.
  • 4+ years of work experience with very large data warehousing environment
  • 4+ years of work experience in Databricks, Pyspark and Python project development work
  • Expertise in Bigdata Eco systems like HDFS and Spark
  • Strong hands-on experience on Python or Scala.
  • Hands on experience on Azure Data Factory.
  • Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
  • Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
  • SQL SERVER development work experience with relational databases and knowledge is a must
  • Development of Stored Procedures for transformations in ETL pipeline
  • Should have work experience in Agile projects
  • Write and maintain documentation of the ETL processes via process flow diagrams.
  • Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
  • Good experience on customer interaction is required.
  • Possesses good interpersonal and communication skills.
(ref:hirist.tech)
  • Azure Data Engineer

    2 weeks ago


    Any Location/Anywhere in India/Multiple Locations, IN hiReign Innoways Full time

    We are seeking a highly motivated and skilled Data Engineer to join our growing team. In this role, you will play a critical role in designing, developing, and maintaining data pipelines using ADF and ADB to integrate, transform, and deliver data for analysis and Design and develop data pipelines using Azure Data Factory (ADF) to automate data movement and...

  • Lead Data Engineer

    1 month ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description :- Primary skills as Azure ADF, Databricks- Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...

  • Senior Data Engineer

    1 month ago


    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Data Engineering Lead

    2 weeks ago


    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Lead Azure Architect

    2 weeks ago


    Bangalore/Jaipur/Udaipur/Kolkata, IN Kadel Labs Private Limited Full time

    Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve clients by practicing an...


  • Anywhere in India/Multiple Locations, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Expereince:6+ YearsLocation: RemotePosition: Permanent- Bachelor's Degree in Computer Science, Engineering, Statistics, or related field.- Minimum of 6 years of experience in machine learning or a related field.- Advanced programming skills in Python, C++, or similar.- Extensive experience with TensorFlow, PyTorch, or similar frameworks.- Deep...

  • DevOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN TRIDENT SERVICES Full time

    Need experience in Banking domain.Job Description :We are seeking a motivated Junior DevOps Engineer to join our dynamic team. As a Junior DevOps Engineer, you will work closely with our development and operations teams to streamline our software development processes, enhance system reliability, and optimize deployment pipelines. This is an excellent...


  • Nagpur/Chennai/Bangalore/Pune, IN Codersbrain technology pvt ltd Full time

    Position Overview :We are seeking experienced Azure Synapse Developers to join our team. The ideal candidates will possess strong expertise in Azure Synapse Analytics and will be self-starters capable of diving into the current infrastructure, evaluating it, and assisting in re-architecting and developing data warehouses into a unified instance. These...

  • Senior Data Engineer

    1 month ago


    Mumbai/Chennai, IN Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Solution Architect

    2 weeks ago


    Anywhere in India/Multiple Locations, IN koantek Full time

    Job Description :- Undergraduate degree or higher in Computer Science, Information Systems, or relevant experience.- Minimum 8+ years experience in a technical role, preferably in the data or cloud field.- Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.- Knowledge of a programming language - Python, Scala, or SQL-...

  • Data Scientist

    1 month ago


    Anywhere in India/Multiple Locations, IN Awign Full time

    About Awign Expert : Awign Expert is an Enterprise focused platform that helps businesses Hire, Assess and Manage high skilled resources for Gig Based Projects. We provide our Experts a gateway to work for and build a freelance/consulting career with large scale Enterprises. We are a newly launched business division of Awign, which is one of the pioneers and...


  • Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    We are looking for a talented and experienced Mobile Application Developer to join our growing team. You will play a key role in designing, developing, and deploying innovative mobile applications that enhance our user experience and drive business Bachelor's Degree in Computer Science or a related field from an accredited university.- Minimum of 6+...

  • AI/ML Researcher

    2 weeks ago


    Anywhere in India/Multiple Locations, IN TALENT XO Full time

    MANDATORY CRITERIA EACH CANDIDATE SHOULD KNOW BEFORE APPLYING - OVER OR LESS EXPERIENCED CANDIDATES WILL NOT BE SHORTLISTED. IF YOUR PROFILE DOES NOT MATCH THE REVIEW CRITERIA YOU WILL NOT GET SHORTLISTED. BE READY WITH YOUR UPDATED CV THAT ALIGNS WITH JD AS COMPANY FOCUSES ON A SCREENING A CV A LOT. Whose Salary is below 15 LPA will not get...


  • Gurgaon/Gurugram/Anywhere in India/Multiple Locations, IN SunKing Full time

    About the role :The Data team is looking for a skilled Machine Learning Engineer to help use state-of-the-art algorithms to analyze our data and uncover patterns otherwise undiscoverable. These will include but are not limited to using unsupervised learning techniques to uncover underlying patterns in customer repayments behavior, building classification...

  • AWS Data Engineer

    1 month ago


    Pune/Hyderabad, IN Huquo Full time

    Role : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...


  • Bangalore/Any Location, IN IT Resource Hunter Full time

    Responsibilities : - Management and maintaining the AAD (user onboarding, application registration, etc.)- Management and administration of databases and data lake (SQL, Cosmos, data lake, etc.)- Ownership and development of infrastructure documentation- Management of user communications regarding maintenance windows, updates, etc.- Stakeholder management...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

  • DevOps Engineer

    1 month ago


    Bangalore/Pune/Hyderabad, IN Shework Full time

    Position Overview :As a DevOps Engineer specializing in Virtualization Infrastructure, you will play a critical role in designing, implementing, and managing our virtualization infrastructure environment. You will leverage your expertise in VMware and VDI technologies to ensure the stability, performance, and scalability of our virtualized systems....

  • DevOps Engineer

    4 weeks ago


    Bangalore/Pune, IN SKPL Antrepriz Solutions Private Limited Full time

    About Dice :The Dice platform, one of the most advanced SaaS fintech organizations, helps businesses convert their spending from many fragmented applications, prepaid cards, offline reimbursement/invoice management, procurement, and payment systems to a single spend platform. There will be no more cash, cards, refunds, or offline invoicing since our entire...

  • DevOps Engineer II

    1 month ago


    Bangalore/Pune, IN Shework Full time

    Position Overview :As a Dev Engineer-II, you will play a key role in leading our web development team and delivering high-quality web solutions using Sitecore and ReactJS. You will collaborate closely with cross-functional teams to architect, develop, and deploy robust web applications that meet business requirements and exceed customer...