Senior Data Engineer
4 weeks ago
Job Description :
Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.
- Translate functional specifications and change requests into technical specifications
- Translate business requirement document, functional specification, and technical specification to related coding
- Develop efficient code with unit testing and code documentation
- Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving
- Setting up the development environment and configuration of the development tools
- Communicate with all the project stakeholders on the project status
- Manage, monitor, and ensure the security and privacy of data to satisfy business needs
- Contribute to the automation of modules, wherever required- To be proficient in written, verbal and presentation communication (English) - Co-ordinating with the UAT team
Role Requirement :
- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)
- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)
- Knowledgeable in Shell / PowerShell scripting
- Knowledgeable in relational databases, nonrelational databases, data streams, and file stores
- Knowledgeable in performance tuning and optimization
- Experience in Data Profiling and Data validation
- Experience in requirements gathering and documentation processes and performing unit testing
- Understanding and Implementing QA and various testing process in the project
- Knowledge in any BI tools will be an added advantage
-Sound aptitude, outstanding logical reasoning, and analytical skills
- Willingness to learn and take initiatives
- Ability to adapt to fast-paced Agile environment
Additional Requirement :
- Demonstrated expertise as a Data Engineer, specializing in Azure cloud services.
- Highly skilled in Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics.
- Create and execute efficient, scalable, and dependable data pipelines utilizing Azure Data Factory.
- Utilize Azure Databricks for data transformation and processing.
- Effectively oversee and enhance data storage solutions, emphasizing Azure Data Lake and other Azure storage services.
- Construct and uphold workflows for data orchestration and scheduling using Azure Data Factory or equivalent tools.
- Proficient in programming languages like Python, SQL, and conversant with pertinent scripting languages.
(ref:hirist.tech)
-
AMAZATIC - Data Engineer/Senior Engineer - Azure
4 weeks ago
Hyderabad/Pune, IN AMAZATIC SOLUTIONS LLP Full timeSenior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong understanding...
-
Senior Data Engineer
4 weeks ago
Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full timeSenior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...
-
Senior Big Data Engineer
4 weeks ago
Bangalore/Pune, IN Recrud Full timeSenior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...
-
AWS Data Engineer
5 days ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
Senior Data Engineer
4 weeks ago
Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full timeJob Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...
-
Senior Cloud Data Engineer
4 weeks ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...
-
Senior Data Engineer
4 weeks ago
Bangalore/Kolkata/Pune, IN Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Senior Data Scientist
5 days ago
Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full timeAbout the Role :We are searching for a talented and experienced Senior Data Scientist to join our team and play a key role in leveraging the power of machine learning (ML) and artificial intelligence (AI) to extract valuable insights from data. In this role, you will be responsible for the entire data science lifecycle, from data acquisition and wrangling to...
-
Senior Data Engineer
2 days ago
Pune/Mysore, IN IT Full timeWe are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library. The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions. Additionally, experience with Azure...
-
Senior Data Engineer
4 weeks ago
Bangalore/Chennai/Madurai, IN Resourcetree Full timeJob Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...
-
Senior Data Engineer
4 weeks ago
Bangalore/Remote, IN Geektrust.in Full timeRole : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...
-
CGI - Data Engineer - Data Pipeline
4 weeks ago
Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full timeRequired Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...
-
Senior Data Engineer
4 weeks ago
Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...
-
Python Data Engineer
4 weeks ago
Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full timeJob Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...
-
Senior Data Engineer
4 weeks ago
Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...
-
Harmony Data Integration Technologies
5 days ago
Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full timeJob Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...
-
AI/ML Engineer
4 weeks ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeSummary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...
-
Data Engineer
4 weeks ago
Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full timePosition Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...
-
Data Engineer
4 weeks ago
Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...
-
Lead Data Engineer
1 week ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeWe are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...