Azure Data Engineering-Technical Lead

4 weeks ago


Surat, India OSBIndia Private Limited Full time

Experience Requirements

  • Overall 8-10 years of IT experience preferably in Data and Analytics implementation.
  • 4-5 years of Data engineering (Both On-prem and Azure) delivery experience including Architecture / analysis / development / configuration/ deployment.
  • 4 years of implementation experience in Azure Data engineering projects
  • Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on Azure Cloud.
  • Expert in Python/SQL/SparkSQL/PySpark
  • Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Datra bricks, perview and Azure App Service is required.
  • Extensive hands-on experience implementing data migration and data processing using Azure services: Serverless Architecture, Azure Storage, Azure SQL DB/DW, Data Factory, Azure Stream Analytics, Azure Analysis Service, Databricks Azure Data Catalog, Cosmos Db, Azure Functions, ARM Templates, Azure DevOps, CI/CD etc.
  • Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.
  • Expert in distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional ETL tools like Informatica, SSIS, etc
  • Should have worked on any NoSQL solutions like Mongo DB, Cassandra, HBase, Cosmos DB etc, or Cloud-based NoSQL offerings like DynamoDB, Big Table, etc.
  • Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage.
  • Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
  • Knowledge in Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, Power BI is desirable.
  • Strong problem solving and troubleshooting skills.
  • Experience in working in a fast-paced agile environment.
  • Strong experience in common data warehouse modelling principles including Kimball, Inmon.
  • Experience with data visualization tools such as Power BI.
  • Experience in Streaming and batch architecture (e.g., Kafka, Kafka streams, Spark, Flink)


Knowledge Requirements

  • Excellent understanding of data technologies landscape/ecosystem (Both On-prem and Cloud)
  • Detailed knowledge of Software development essential.
  • Detailed knowledge of SQL (Structured Query Language) programming is essential.
  • Proven experience in business and technical problem-solving skills is essential.
  • Proven ability to build, manage and foster a team-oriented environment
  • Proven ability to work creatively and analytically in a problem-solving environment
  • Excellent communication (written and oral) and interpersonal skills
  • Excellent organizational, multi-tasking, and time-management skills


  • Surat, India OSBIndia Private Limited Full time

    Experience RequirementsOverall 12-15 years of IT experience preferably in Data and Analytics implementation.7-8 years of Data engineering (Both On-prem and Azure) delivery experience including Architecture / analysis / development / configuration/ deployment. 4-5 years of implementation experience in Azure Data engineering projectsMandatory to have knowledge...

  • Technical Lead

    3 days ago


    Surat, India Breezy Talent Full time

    We are hiring for our clientGainserv Infotech PvtLtd.GreetingsFromGainserv!GainservInfotech Pvt Ltd is a USA based product development companycreating innovative cloud software solutions for businesses.Our mission is to revolutionize useronboarding experiences. Our productUserlove simplifies user onboarding boosts engagement andaccelerates adoption without...

  • Technical Lead

    4 days ago


    Surat, India Finding Candidates Full time

    We are hiring for our clientGainserv Infotech PvtLtd.GreetingsFromGainserv!GainservInfotech Pvt Ltd is a USA based product development companycreating innovative cloud software solutions for businesses.Our mission is to revolutionize useronboarding experiences. Our productUserlove simplifies user onboarding boosts engagement andaccelerates adoption without...

  • Lead Data Architect

    4 days ago


    Surat, India ACL Digital Full time

    Position:-Lead Data ArchitectCompany:- ACL DigitalExperience:- 10 to 15 yearsNotice Period:- 30 to 45 days Location:- Pune(Balewadi)Job Description:-Experience: Minimum of 15 years of experience in data engineering or a related field, with a proven track record of leading large-scale data projects.Extensive experience in designing and implementing data...

  • Azure Data Factory

    3 months ago


    Surat, India EC2 Consulting Solutions Full time

    Role: Azure Data Factory Experience - 4+ years - Worked-on project experience is required in Azure data factory pipelines, Azure data flow, Azure data bricks, Azure Data Lake gen2, and Azure Synapse. - Worked-on project experience in the programming languages Python and PySpark. - Worked with both SQL and NoSQL databases. - Strong knowledge and experience...

  • Azure Data Factory

    3 months ago


    Surat, India EC2 Consulting Solutions Full time

    Role: Azure Data Factory Experience - 4+ years - Worked-on project experience is required in Azure data factory pipelines, Azure data flow, Azure data bricks, Azure Data Lake gen2, and Azure Synapse. - Worked-on project experience in the programming languages Python and PySpark. - Worked with both SQL and NoSQL databases. - Strong knowledge and experience...

  • DevOps Manager

    3 months ago


    Surat, India Aricent Full time

    Profile : DevOps ManagerJob description :- Unilever is going through a major transformation journey- The ambition is to become a data intelligent company- To increase its data capabilities, we are looking for an experienced technical solution design manager that will help enabling our strategy through the design of robust, reliable, performing and cost...


  • surat, India BLYK Engineering Services Full time

    Job Summary: The Lead Embedded Software Engineer will oversee the development and implementation of advanced embedded software solutions. This role involves leading a team of engineers, managing project timelines, and ensuring the delivery of high-quality embedded systems. The ideal candidate will have extensive experience in embedded software development,...

  • Data Scientist

    3 months ago


    Surat, Gujarat, India Blue Data Consulting Full time

    **Data Scientist** **Key Responsibilities**: - Develop and implement NLP solutions for text analysis, sentiment analysis, and language understanding. - Utilize Python programming for data manipulation, model building, and data visualization tasks. - Collaborate with cross-functional teams to integrate data science solutions into cloud environments,...

  • Data Engineer Sr

    1 month ago


    Surat, India Eveo Full time

    Job DescriptionAbout EveoAI:EveoAI is a pioneering startup in the fashion technology space, leveraging AI and AR to revolutionize personal fashion design and personality management. We are building cutting-edge solutions to provide virtual fashion trials, personality assessments, and AI-driven wardrobe management. Join us in transforming how people interact...

  • Senior Data Engineer

    3 weeks ago


    Surat, India Mastek Full time

    Min Work Experience 7-10 YearsRole: Senior Data EngineerExtensive experience in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc.) across Fractal and contributes to open-source Big Data technologies.Write and tune complex Java, MapReduce, and Hive jobs.Experience leading a Backend/Distributed...


  • Surat, India Tejas Networks Full time

    About Tejas Networks:Tejas Networks is an R&D-driven organization focused on being at the forefront of technological advancements in the field of telecommunications. With an R&D team comprising of more than 50% of the organization strength, we have continued to invest in the development of new product capabilities. Our products include carrier-grade optical...


  • surat, India Team Geek Solutions Full time

    We’re Hiring! Join Prowesstics as a Python Data Engineer! Company : Prowesstics Position : Python Data Engineer Location : Chennai, Tamil Nadu Experience : 2-3 Years Type : Full-time Budget : ₹3-7 LPA Notice Period : 15-30 days Are you a skilled Python Data Engineer with a passion for building and maintaining scalable data pipelines? We are looking...

  • Data Engineer Sr

    1 month ago


    Surat, India Eveo Full time

    About EveoAI:EveoAI is a pioneering startup in the fashion technology space, leveraging AI and AR to revolutionize personal fashion design and personality management. We are building cutting-edge solutions to provide virtual fashion trials, personality assessments, and AI-driven wardrobe management. Join us in transforming how people interact with fashion...

  • Data Engineer

    4 days ago


    surat, India hrtech Full time

    Role : Data Engineer GCP Build Job type : Long term contract ( 3 Years) Work Place type : Hybrid Data Engineer : You will be responsible for designing, building, and maintaining our data infrastructure, ensuring data quality, and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data...


  • Surat, India Techs to Suit Inc Full time

    Client- Renowned Mid sized IT CompanyLocation - BangaloreJoining time - 2 monthsDesignation - Associate Director / Principal Architect Data EngineeringKey Skills - Role is 70% Technical. 30 % managerial as need to manage team of 10 to 15Must have experience in Multi CloudMust be from Data warehousing development backgroundCandidates Must Have:13 years of...


  • surat, India IntraEdge Full time

    About Intraedge: Intraedge is a Technology, Products and Learning Organization, It was founded in 2002 with offices in the US, India, Europe, Canada, and Singapore. We provide our clients with the resources and expertise to enhance business performance through technology. About American Express: American Express is a globally integrated payments company,...

  • Implementation Lead

    2 days ago


    surat, India Persistent Systems Full time

    About Position: SIEM + SOAR Implementation Specialist with expertise in SIEM tools (like QRadar on Cloud (QROC), Splunk, Rapid7) is a crucial member of an organization's cybersecurity team, responsible for implementation and providing advanced technical support and incident response. Role: Implementation Lead Location: All PSL Location Experience: 8 to...


  • Surat, India HCLTech Full time

    Drive and lead a portfolio of Projects related to engineering systems used in developing windows images, provisioning tools, and custom packages for deployment on windows devices. Skills sets : C#, ADO, Azure build & release pipelines, Python, PowerShell. Key Responsibilities: Drive and manage a portfolio of programs including Azure DevOps, Imaging &...


  • Surat, Gujarat, India Blue Data Consulting Full time

    **Key responsibilities**: - Design and implement cloud solutions, build MLOps on cloud (AWS, Azure, or GCP) - Build CI/CD pipelines orchestration by GitLab CI, GitHub Actions, Circle CI, Airflow or similar tools - Data science model review, run the code refactoring and optimization, containerization, deployment, versioning, and monitoring of its quality -...