
Senior Data Engineer
23 hours ago
The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficiency and speed, strong project management skills, and a core value base for how analytics can proactively improve organizations. You will be part of the Data & Analytics team and will partner closely with a team of data scientists, business analysts & business intelligence leading a cloud-based strategy for our clients.About the RoleYou'll work on our Azure based data pipeline projects with a focus on collecting, parsing, managing, analysing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure data cloud environment is architected to gain real insights faster, with less friction and complexity. Ideal candidate should be a champion of building a distributed and scalable architecture that is metadata driven. You're also a detail-oriented person that believes data quality should never be sacrificed.Mandatory Skills: Python, SQL, Snowflake, Cloud Experience - 5 to 7 yrs Location - Bangalore Work Mode - HybridResponsibilities:Master the use of technology & modern tools to optimize solutions and continuous process improvementsFacilitate team to design, build and test end to end data pipeline including data ingestion (streaming, events and batch), data integration, data curationHelp build out and support an Enterprise Data MarketplaceAdminister the Big data platform on the cloudImplement automation of jobs and testingOptimize the data pipeline to support ML workloads and use casesSupport mission critical applications and near real time data needs from the data platformBuild and support reusable framework to ingest, integration and provision dataCapture and publish metadata and new data to subscribed usersWork collaboratively with product managers, data scientists as well as business partners and actively participate in design thinking sessionMotivate, coach, and serve as a role model and mentor for other development team associates/members that leverage the platformEstablish relationship with key business lines, Infosec and infrastructure teamEnsure security is integrated into all cloud services.Build, monitor, and manage the cloud infrastructure.Monitor and optimize cloud workloads.Review current and future Azure implementations and suggest ways to improve and standardize the cloud offerings. QualificationsBachelor’s degree in Computer Science, Physics, Mathematics, Statistics or other Engineering disciplines Required Skills:5+ years' experience as Data engineerExperience with big data tools: Spark, DatabricksExperience with building relational SQL Data WarehousesGood Hands on experience with data pipeline and workflow management tools: Azure Data Factory, SSISExperience with object-oriented/object function scripting languages: Python, C#, Scala, VBA, etc.Experience with systems scripting languages: Batch Scripts, PowershellExperience with Git/GitHub and automating buildsStrong interpersonal, verbal and written communication skills and ability to present complex technical/analytical concepts to executive audienceStrong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery Preferred Skills:Experience building distributed architecture and IoT in a Dev/Ops environmentExperience in both Agile and Waterfall methodologiesExperience building and optimizing claims data pipelines, architectures/data models and data sets.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Experience with the Agile workflow, Test Driven Development, and continuous improvement/continuous deployment.Strong analytic skills related to working with structured and unstructured datasets.Build processes supporting data transformation, data structures, metadata, dependency and workload management using Azure Automation, Azure Function Apps, and Azure Data Factory.A successful history of manipulating, processing and extracting value from large disconnected datasets.Working knowledge of Azure Automation, Azure Data Factory, and highly scalable 'big data' data stores such as Azure Blob Storage, Azure Data LakeExperience supporting and working with cross-functional teams in a dynamic environment.Excellent planning, prioritization, problem solving skills.Experience with any of the following scripting languages, R, JSON, Parquet, JavaScript, Regex, PowerShell, shell scripting. Experience with Data Bricks, HDInsight, Python.
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka ITC Infotech Full timeSenior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...
-
Data Senior Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per yearReq ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka Publicis Production Full timeJob Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka 6thStreet.com Full timeJob Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka JRD Systems Full timeWe are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka Avathon Full timeWho We Are & Why Join UsAvathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka Grid Dynamics Full timeAbout Company Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud...
-
Senior Data Engineer
23 hours ago
Bengaluru, Karnataka, India, Karnataka Benchire Full timeHi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore .Requirements:· Min 6-8 years of professional experience· Minimum of three years of professional experience with Python· Professional experience in the field of data (e.g., data science, data engineering, data warehousing)· Experience...
-
Senior Data Engineer cum Data Scientist
7 hours ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...
-
Senior Azure Data Engineer
2 days ago
Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...