StaidLogic - Senior Data Engineer - SQL/Python
4 weeks ago
Role : Senior Data Engineer.
Experience : 8-10 Years.
Role Description.
This is a contract Senior Data Engineer role located in Pune, India.
The Senior Data Engineer will be responsible for Data Engineering, Data Modeling, Extract Transform Load (ETL), Data Warehousing, and Data Analytics on a day-to-day basis.
Data Engineer
We're looking for a Big Data Lead Engineer to :
- Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively.
- Transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques.
- Develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.
- Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.
- Build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues.
- Understand, represent, and advocate for client needs.
- Codify best practices, methodology and share knowledge with other engineers in UBS.
- Shape the Data and Distribution architecture and technology stack within our new cloud-based datalake-house.
- Be a hands-on contributor, senior lead in the big data and data lake space, capable to collaborate and influence architectural and design principles across batch and real time flows.
- Have a continuous improvement mindset, who is always on the lookout for ways to automate and reduce time to market for deliveries.
Your Expertise :
- Experience in building Data Processing pipeline using various ETL/ELT design patterns and methodologies to Azure data solution, building solutions using ADLSv2, Azure Data factory, Databricks, Python and PySpark.
- Experience with at least one of the following technologies: Scala/Java or Python.
- Deep understanding of the software development craft, with focus on cloud based (Azure), event driven solutions and architectures, with key focus on Apache Spark batch and streaming, Datalakehouses using medallion architecture.
- Knowledge of DataMesh principles is added plus.
- Ability to debug using tools Ganglia UI, expertise in Optimizing Spark Jobs.
- The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate datasets.
- Expert in creating data structures optimized for storage and various query patterns for e.
- Parquet and Delta Lake.
- Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD) / ETL tools (Azure Data factory, Informatica).
- Experience in data modelling atleast one database technology such as:.
- Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL).
- NoSQL (MongoDB, Cassandra, Neo4J, CosmosDB, Gremlin).
- Understanding of Information Security principles to ensure compliant handling and management of data.
- Ability to clearly communicate complex solutions.
- Strong problem solving and analytical skills.
- Working experience in Agile methodologies (SCRUM).
- A proven team player with strong leadership skills, who can work in a collaborative way across business units, teams and regions.
Qualifications :
- Data Engineering and Data Modeling skills.
- Experience with Extract Transform Load (ETL) processes.
- Experience with cloud platforms like AWS or Azure.
- 9+ years of experience in a similar role.
-
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole : Software Development Engineer in Test (SDET). Location : Pune. Experience : Total 6 years. Role Description :- This is a contract hybrid role for a Software Development Engineer in Test (SDET) at StaidLogic.- The SDET will be responsible for designing and implementing automated testing solutions, collaborating with development teams to ensure quality...
-
Data Engineer Lead
5 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob Description">We are seeking a highly skilled Data Engineer Lead to join our team at STAIDLOGIC SOFTWARE PRIVATE LIMITED. As a Senior Data Engineering position, you will be responsible for designing and implementing scalable data pipelines, ensuring the quality and reliability of our data solutions.">Responsibilities:">Design and implement ETL/ELT...
-
Senior Data Engineering Position
5 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob Summary">We are seeking an experienced Cloud Data Architect to join our team at STAIDLOGIC SOFTWARE PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures, ensuring the quality and reliability of our data solutions.">Key Responsibilities:">Design and implement...
-
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole : Test Automation Engineer. Location : Pune. Experience : 8-10 Years. Role Description : This is a contract role for a Senior Quality Assurance Automation Engineer in the Finance Domain at StaidLogic, located in Hyderabad. The role involves creating and executing test cases, conducting manual and software testing, and implementing QA automation to...
-
Senior Python Developer
4 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeAbout UsStaidlogic Software Private Limited is a leading provider of innovative software solutions. We are committed to delivering high-quality products that meet the evolving needs of our customers. Our team of experienced professionals works collaboratively to design, develop, and deploy scalable, efficient, and reliable software applications using Python...
-
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole : Test Automation Engineer. Location : Pune. Experience : 8-10 Years. Role Description : This is a contract role for a Senior Quality Assurance Automation Engineer in the Finance Domain at StaidLogic, located in Hyderabad. The role involves creating and executing test cases, conducting manual and software testing, and implementing QA automation to...
-
Cloud Data Architect
4 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob Role">As a Senior Data Engineer, you will play a critical role in shaping the future of data engineering at STAIDLOGIC SOFTWARE PRIVATE LIMITED. You will be responsible for designing and implementing data pipelines, ensuring the quality and reliability of our data solutions.">Key Accountabilities:">Design and implement data pipelines using Azure data...
-
Python Developer
5 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob DescriptionAt Staidlogic, we are seeking an experienced Python Developer to join our team. As a key member of our engineering department, you will play a critical role in designing and developing scalable, efficient, and reliable software solutions using Python and its frameworks such as Django or Flask.Key Responsibilities:Design, develop, test, and...
-
StaidLogic - UI Developer/Lead - Javascript
4 weeks ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole : UI Developer / Lead. Location : Pune, Maharashtra, India. Role Description. This is a contract role for a UI Developer/Lead at StaidLogic in Pune. - The role involves designing and developing optimized digital environments, implementing cloud and digital solutions, and maximizing operational efficiency through intelligent automation. - The UI...
-
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole : Python Developer. Experience : 5 years. Location : Pune. Job Description : - Proven experience of more than 5 years as a Python Developer or similar role. - Proficiency in Python and its frameworks such as Django or Flask. - Strong knowledge of back-end technologies and RESTful APIs. - Experience in Pandas, and knowledge of AI/ML libraries like...
-
Senior Quality Assurance Expert
5 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob Overview">We are looking for a Senior Quality Assurance Expert to lead our test automation efforts at StaidLogic Software Private Limited. The successful candidate will be responsible for designing and implementing automation frameworks, managing infrastructure, and collaborating with cross-functional teams to deliver high-quality software products.">The...
-
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole : Python Developer. Experience : 5 years. Location : Pune. Job Description :- Proven experience of more than 5 years as a Python Developer or similar role.- Proficiency in Python and its frameworks such as Django or Flask.- Strong knowledge of back-end technologies and RESTful APIs.- Experience in Pandas, and knowledge of AI/ML libraries like...
-
Automation Engineer in Finance
5 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob Description">We are seeking a seasoned Test Automation Specialist to join our team at StaidLogic Software Private Limited. As a key member of our quality assurance team, you will be responsible for designing and implementing automation frameworks to ensure high-quality software products for the finance industry.">The ideal candidate will have 8-10 years...
-
Software Engineer
5 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob OverviewWe are Staidlogic Software Private Limited, a leading provider of innovative software solutions. We are committed to delivering high-quality products that meet the evolving needs of our customers. As a key member of our team, you will have the opportunity to work on challenging projects, collaborate with talented individuals, and contribute to...
-
Senior Java Software Engineer
20 hours ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeJob Overview:A Senior Java Software Engineer with expertise in Spring Boot is required to join our team at STAIDLOGIC SOFTWARE PRIVATE LIMITED. This role involves working on designing and implementing software solutions using Java and Spring Framework.About the Role:The successful candidate will be responsible for designing and implementing software...
-
Test Automation Specialist
4 days ago
Pune, Maharashtra, India STAIDLOGIC SOFTWARE PRIVATE LIMITED Full timeRole Summary">We are seeking a Test Automation Specialist to join our team at StaidLogic Software Private Limited. The successful candidate will be responsible for designing and implementing automation frameworks, managing infrastructure, and collaborating with cross-functional teams to deliver high-quality software products.">The ideal candidate will have...
-
VThrive - Data Engineer - SQL/Python
5 days ago
Pune, Maharashtra, India Vthrivesolutions Full timePrimary Responsibilities : - Use knowledge to architect data warehousing and BI solutions that solve problems that cut across multiple business functions. - Interact with business customers, gathering requirements and delivering complete Data Engineering, Data Warehousing, and analytics solutions. - Interface with other technology teams to extract,...
-
Python Data engineer
3 weeks ago
Pune, Maharashtra, India Peak hawks LLP Full timeJob Details: Position: Python Data Engineer Experience: 4-6 Work Mode: Onsite Budget: 18-20LPA Location: Viman Nagar Rd, Pune. • Strong experience in Python, DataBricks, and PySpark and good experience in SQL • Experience in handling the team and Client facing. • 2 Virtual Round: Technical interview covering the core skills of Python coding, Numpy,...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India Trigent Software Pvt. Ltd Full timeSenior Data Engineer. Location : Hyderabad, Bangalore, Pune (Hybrid). Experience : 6 years overall, 4 years relevant. Job Description : We are looking for a Senior Data Engineer with expertise in Azure Data Factory, Azure Databricks, Python/PySpark, and SQL to join our team. The ideal candidate will play a key role in designing, building, and optimizing...
-
VThrive - Data Engineer - SQL/Python
3 weeks ago
Pune, Maharashtra, India Vthrivesolutions Full timePrimary Responsibilities : - Use knowledge to architect data warehousing and BI solutions that solve problems that cut across multiple business functions.- Interact with business customers, gathering requirements and delivering complete Data Engineering, Data Warehousing, and analytics solutions.- Interface with other technology teams to extract, transform,...