Senior Data Engineer
5 days ago
Hi,
Opportunity open for Bell Integration -Senior Data Engineer.
Experience - 10+ years.
Interview mode - Virtual.
Overview:
We are seeking a talented Senior Data Engineer specializing in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimizing Starburst installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis.
Responsibilities:
• Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations, overseeing environment setup, configuration, maintenance, upgrades, and ensuring optimal performance.
• Configure various server and application settings and parameters.
• Integrate Starburst with various data sources to create a unified data platform.
• Design and tune the container solution for performance and scalability.
• Set up and configure data catalogs in various modes.
• Implement robust security controls for data access, ensure compliance with data regulations, and manage potential vulnerabilities.
• Coordinate with various support partners and vendor teams.
• Troubleshoot and investigate server related issues and provide root cause analysis for incidents.
• Perform daily server administration and monitoring, and leverage automation (such as Ansible) for efficient maintenance.
• Plan and execute disaster recovery testing.
• Create documentation and provide training on Starburst administration and best practices.
Qualifications:
• Required Skills & Experience:
• Bachelor’s degree in Computer Science, Information Systems, Data Science, Engineering or related field (or equivalent work experience).
• Proven experience with Trino/Starburst Enterprise/Galaxy administration / CLI.
• Implementation experience with container orchestration solutions (Kubernetes/OpenShift).
• Knowledge of Big Data (Hadoop/Hive/Spark) and Cloud technologies (AWS, Azure, GCP).
• Understanding of distributed system architecture, high availability, scalability, and fault tolerance.
• Familiarity with security authentication systems such as LDAP, Active Directory, OAuth2, Kerberos.
• Excellent Unix/Linux skills.
• Familiarity with JDBC / ODBC
• Preferred Skills:
• Certification: Starburst Certified Practitioner.
• Experience Python and/or Java programming.
• Proficient with infrastructure automation tools such as Ansible.
• Knowledge of data requirements for AI and machine learning workloads.
• Familiarity with Data Federation and Cached Services
• Familiarity with Data pipeline (Series of steps that move and transform data from one source to another for analyses and storage)
• Experience with Dell Data Lakehouse administration.
• Experience in Demand Driven Adaptive Enterprise (DDAE) administration
• Working Conditions
• This position may require evening and weekend work for time-sensitive project implementations.
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana Straive Full timeJob SummaryWe're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana Quadrant Technologies Full timeQuadrant Technologies seeks a Senior Data Engineer (10+ Years) to lead high-impact data modernization and migration projects for enterprise clients, specializing in Microsoft Fabric and Azure Data Services.Job role: Sr Data EngineerLocation: Chennai, Bengaluru, HyderabadKey Focus Areas:Fabric/Azure Leadership: Drive end-to-end cloud data migration,...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana 247Hire Full timeSenior Data Engineer Location: HyderabadJob Type: Full TimeWork Mode: HybridPay Rate: Open to discussAbout 247Hire:Proven offshore recruitment solutions including candidate sourcing, screening & recruiting, sales development, VMS recruiting and more.At 247Hire, our mission is simple: to empower yours. From sourcing to recruiting, VMS, onboarding and beyond,...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana Talentoj Full timeExperience: 5–8 Years Location: [Open Location] | Type: Full-TimeJob SummaryWe are looking for a highly experienced Senior Data Engineer with strong expertise in Python, Advanced SQL, Snowflake, Amazon Redshift, Databricks, and Tableau. The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana Saras Analytics Full timeAbout Saras Analytics:We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformation, visualization & analysis of data delivered via industry leading products, solutions & services. Our flagship product is Daton, an ETL...
-
Data Engineer
3 days ago
Hyderabad, Telangana, India, Telangana KPI Partners Full timeWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at KPI Partners.Key Responsibilities:Design, build, and maintain scalable data pipelines for ingestion, transformation, and delivery.Implement and optimize workflows using DBT (Data Build Tool).Utilize Airbyte for data integration across multiple sources and...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana Sonatype Full timeSonatype is the software supply chain security company. We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain...
-
Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana People Tech Group Inc Full timeJob Description:Job Title: Data Engineer Experience: 5-10 YearsLocation: HyderabadJob Type: Full-TimeJob Summary:We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects. The ideal candidate will have strong expertise in SQL, Python, data modeling, and building scalable data pipelines....
-
Senior Quality Assurance Engineer
7 days ago
Hyderabad, Telangana, India, Telangana SJ Mobilita Full timeSenior QA Engineer – Data Automation Introduction: As a Senior Test Automation Engineer on the Insights team , you’ll play a key role in shaping how we build trust in the data that powers our products. You’ll work closely with our data engineering and reporting teams, who deliver critical insights to gyms and fitness franchises through high-impact...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana People Tech Group Inc Full timeJob Title: Data EngineerLocation: HyderabadExperience: 5+Years (Work from Office)Job Summary:We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline...