Azure Databricks Engineer
1 month ago
Position/Role : Azure data bricks with Pyspark/Spark/Python and SQL
Experience : 6-12 yrs
Location : Hyderabad/Bangalore/Pune/Mumbai/Chennai (Hybrid)
Job Overview :
Primary Skills : Databricks with Pyspark/Spark/ Python and SQL
Secondary skills : ADF
Job Description :
- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.
- 4+ years of work experience with very large data warehousing environment
- 4+ years of work experience in Databricks, Pyspark and Python project development work
- Expertise in Bigdata Eco systems like HDFS and Spark
- Strong hands-on experience on Python or Scala.
- Hands on experience on Azure Data Factory.
- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
- SQL SERVER development work experience with relational databases and knowledge is a must
- Development of Stored Procedures for transformations in ETL pipeline
- Should have work experience in Agile projects
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
- Good experience on customer interaction is required.
- Possesses good interpersonal and communication skills.
-
Azure Data Engineer
2 weeks ago
Any Location/Anywhere in India/Multiple Locations, IN hiReign Innoways Full timeWe are seeking a highly motivated and skilled Data Engineer to join our growing team. In this role, you will play a critical role in designing, developing, and maintaining data pipelines using ADF and ADB to integrate, transform, and deliver data for analysis and Design and develop data pipelines using Azure Data Factory (ADF) to automate data movement and...
-
Lead Data Engineer
1 month ago
Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full timeJob Description :- Primary skills as Azure ADF, Databricks- Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...
-
Senior Data Engineer
1 month ago
Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full timeJob Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...
-
Data Engineering Lead
2 weeks ago
Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full timeJob Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...
-
Lead Azure Architect
2 weeks ago
Bangalore/Jaipur/Udaipur/Kolkata, IN Kadel Labs Private Limited Full timeKadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve clients by practicing an...
-
Machine Learning Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeExpereince:6+ YearsLocation: RemotePosition: Permanent- Bachelor's Degree in Computer Science, Engineering, Statistics, or related field.- Minimum of 6 years of experience in machine learning or a related field.- Advanced programming skills in Python, C++, or similar.- Extensive experience with TensorFlow, PyTorch, or similar frameworks.- Deep...
-
DevOps Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN TRIDENT SERVICES Full timeNeed experience in Banking domain.Job Description :We are seeking a motivated Junior DevOps Engineer to join our dynamic team. As a Junior DevOps Engineer, you will work closely with our development and operations teams to streamline our software development processes, enhance system reliability, and optimize deployment pipelines. This is an excellent...
-
Azure Synapse Developer
2 weeks ago
Nagpur/Chennai/Bangalore/Pune, IN Codersbrain technology pvt ltd Full timePosition Overview :We are seeking experienced Azure Synapse Developers to join our team. The ideal candidates will possess strong expertise in Azure Synapse Analytics and will be self-starters capable of diving into the current infrastructure, evaluating it, and assisting in re-architecting and developing data warehouses into a unified instance. These...
-
Senior Data Engineer
1 month ago
Mumbai/Chennai, IN Cyber Sphere LLC Full timeSenior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...
-
Solution Architect
2 weeks ago
Anywhere in India/Multiple Locations, IN koantek Full timeJob Description :- Undergraduate degree or higher in Computer Science, Information Systems, or relevant experience.- Minimum 8+ years experience in a technical role, preferably in the data or cloud field.- Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.- Knowledge of a programming language - Python, Scala, or SQL-...
-
Data Scientist
1 month ago
Anywhere in India/Multiple Locations, IN Awign Full timeAbout Awign Expert : Awign Expert is an Enterprise focused platform that helps businesses Hire, Assess and Manage high skilled resources for Gig Based Projects. We provide our Experts a gateway to work for and build a freelance/consulting career with large scale Enterprises. We are a newly launched business division of Awign, which is one of the pioneers and...
-
Mobile Application Developer
1 month ago
Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full timeWe are looking for a talented and experienced Mobile Application Developer to join our growing team. You will play a key role in designing, developing, and deploying innovative mobile applications that enhance our user experience and drive business Bachelor's Degree in Computer Science or a related field from an accredited university.- Minimum of 6+...
-
AI/ML Researcher
2 weeks ago
Anywhere in India/Multiple Locations, IN TALENT XO Full timeMANDATORY CRITERIA EACH CANDIDATE SHOULD KNOW BEFORE APPLYING - OVER OR LESS EXPERIENCED CANDIDATES WILL NOT BE SHORTLISTED. IF YOUR PROFILE DOES NOT MATCH THE REVIEW CRITERIA YOU WILL NOT GET SHORTLISTED. BE READY WITH YOUR UPDATED CV THAT ALIGNS WITH JD AS COMPANY FOCUSES ON A SCREENING A CV A LOT. Whose Salary is below 15 LPA will not get...
-
Machine Learning Engineer
3 weeks ago
Gurgaon/Gurugram/Anywhere in India/Multiple Locations, IN SunKing Full timeAbout the role :The Data team is looking for a skilled Machine Learning Engineer to help use state-of-the-art algorithms to analyze our data and uncover patterns otherwise undiscoverable. These will include but are not limited to using unsupervised learning techniques to uncover underlying patterns in customer repayments behavior, building classification...
-
AWS Data Engineer
1 month ago
Pune/Hyderabad, IN Huquo Full timeRole : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...
-
Senior Azure Administrator
3 weeks ago
Bangalore/Any Location, IN IT Resource Hunter Full timeResponsibilities : - Management and maintaining the AAD (user onboarding, application registration, etc.)- Management and administration of databases and data lake (SQL, Cosmos, data lake, etc.)- Ownership and development of infrastructure documentation- Management of user communications regarding maintenance windows, updates, etc.- Stakeholder management...
-
Senior Cloud Data Engineer
1 month ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...
-
DevOps Engineer
1 month ago
Bangalore/Pune/Hyderabad, IN Shework Full timePosition Overview :As a DevOps Engineer specializing in Virtualization Infrastructure, you will play a critical role in designing, implementing, and managing our virtualization infrastructure environment. You will leverage your expertise in VMware and VDI technologies to ensure the stability, performance, and scalability of our virtualized systems....
-
DevOps Engineer
4 weeks ago
Bangalore/Pune, IN SKPL Antrepriz Solutions Private Limited Full timeAbout Dice :The Dice platform, one of the most advanced SaaS fintech organizations, helps businesses convert their spending from many fragmented applications, prepaid cards, offline reimbursement/invoice management, procurement, and payment systems to a single spend platform. There will be no more cash, cards, refunds, or offline invoicing since our entire...
-
DevOps Engineer II
1 month ago
Bangalore/Pune, IN Shework Full timePosition Overview :As a Dev Engineer-II, you will play a key role in leading our web development team and delivering high-quality web solutions using Sitecore and ReactJS. You will collaborate closely with cross-functional teams to architect, develop, and deploy robust web applications that meet business requirements and exceed customer...