Data Engineer
4 weeks ago
Job Description: Azure Data Factory & Power BI Developer
Position: Data Engineer
Experience Level: 7+ years
Location: [Remote/Bangalore]
Job Type: Full-Time
Job Summary:
The Azure Data Factory & Power BI Developer will be responsible for designing, developing, and managing data integration solutions using Azure Data Factory, as well as creating visually compelling dashboards and reports using Power BI. You will work closely with business stakeholders to understand their data needs, extract, transform, and load data from various sources, and transform data into insightful, actionable reports for decision-making.
Key Responsibilities:
- Azure Data Factory Development:
- Design, develop, and maintain scalable and efficient ETL pipelines using Azure Data Factory (ADF) for extracting, transforming, and loading data from multiple on-premises and cloud sources to Azure-based storage solutions.
- Create, configure, and manage linked services, datasets, pipelines, and triggers within Azure Data Factory.
- Automate and schedule data workflows using ADF to handle both real-time and batch data processing.
- Ensure data pipelines are optimized for performance and scalability, meeting operational SLAs.
- Power BI Development:
- Design and develop Power BI dashboards, reports, and data visualizations that align with business requirements and provide actionable insights.
- Implement complex DAX measures, Power Query transformations, and custom visuals for optimized reporting.
- Develop and maintain Power BI data models that support high-performance querying and reporting.
- Integrate Power BI with data from various sources, ensuring seamless and secure data flow from backend systems (Azure Data Lake, SQL Database, Data Warehouses, etc.).
- Data Modeling & Integration:
- Work closely with data engineers and architects to create data models that ensure data is structured for efficient querying and reporting.
- Design and implement data integration solutions that enable a seamless flow of data between source systems and Power BI reports.
- Collaboration & Requirements Gathering:
- Engage with business stakeholders to understand data needs, define reporting requirements, and translate them into technical solutions.
- Collaborate with data engineers to integrate new data sources and ensure data consistency and accuracy in reports.
- Performance Optimization:
- Tune both Azure Data Factory pipelines and Power BI reports for high performance, focusing on query optimization, resource utilization, and report loading times.
- Security & Governance:
- Implement security and data governance best practices to ensure sensitive data is protected and compliant with relevant regulations (e.g., GDPR, HIPAA).
- Ensure role-based access and secure data-sharing policies are implemented within Power BI and Azure Data Factory.
- Documentation & Support:
- Provide comprehensive documentation on ETL processes, data models, and Power BI report designs.
- Provide ongoing support for production environments, monitor data workflows, and troubleshoot performance or data-related issues.
Required Skills & Qualifications:
- Experience: At least 7 years of experience in data integration, ETL development, and data visualization, with a strong focus on Azure Data Factory and Power BI.
- Azure Data Factory Expertise: Proficient in Azure Data Factory for creating and managing data pipelines, and working with linked services, datasets, and triggers. Experience with Azure Data Lake, Blob Storage, and SQL-based solutions is a must.
- Power BI Development: Strong experience in Power BI dashboard/report creation, DAX, Power Query, data modeling, and advanced visualization techniques.
- SQL Skills: Advanced knowledge of SQL for querying and transforming data. Experience with database management systems such as SQL Server, Azure SQL Database, or other relational databases.
- ETL Process Knowledge: Strong understanding of ETL processes and data integration best practices for cloud-based data solutions.
- Data Modeling: Knowledge of data warehousing and dimensional data modeling concepts, as well as the ability to design efficient and scalable data models.
- Cloud Expertise: Experience with Azure cloud technologies, including Azure Data Lake, Azure SQL, Azure Synapse Analytics, and related Azure data services.
- Performance Optimization: Proven ability to optimize the performance of both Azure Data Factory pipelines and Power BI reports, ensuring that they meet performance and scalability standards.
- Problem-Solving: Strong analytical skills and the ability to troubleshoot complex data issues, identify root causes, and implement solutions quickly.
- Communication Skills: Excellent verbal and written communication skills with the ability to interact with stakeholders, both technical and non-technical.
- Agile Methodology: Experience working in Agile environments, using tools such as Jira, Azure DevOps, or similar.
Desirable Skills:
- Certification in Microsoft Azure Data Engineer or Power BI.
- Experience with Azure Synapse Analytics, Azure Databricks, and other advanced data engineering services.
- Knowledge of advanced data visualization techniques and custom visuals within Power BI.
- Familiarity with data governance frameworks and compliance standards (e.g., GDPR, HIPAA).
- Familiarity with version control systems such as Git.
Education:
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. Master's degree or relevant certifications (e.g., Microsoft Azure Data Engineer) is a plus.
-
Data Engineer
2 months ago
alappuzha, India USEReady Full timeJob Title: Data EngineerLocation: RemoteJob Summary:We are looking for a skilled Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience with Snowflake, data warehousing, data pipelines, and modern data engineering tools.You will play a key role in designing, building, and maintaining our data infrastructure, ensuring...
-
Data Engineer
4 months ago
Alappuzha, India Giant Eagle GCC Full timeData Engineer -Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...
-
Senior ETL Data Engineer
1 week ago
Alappuzha, India VHL Technologies Inc Full timeRate Range: 20-25We need data engineers Proficient and hands on experience with ETL(Talend and Datastage).He/She should be well versed with SQL and NoSQL DBs as well as good at python.Sound knowledge of SparkSound communication skills and banking experience is a plus.
-
Data Modeler
2 weeks ago
Alappuzha, India Bajaj Finserv Full timeWe Have an Urgent role of BI Data Engineer in Pune MHNote: Willing to relocate to Abu Dhabi onsitePrimary RoleWe are looking for an experienced Data Warehouse (DWH) Data Modeler and Power BI expert with a proven track record to join our dynamic, customer-focused team as an onsite lead for our Middle East accounts. This role is ideal for a professional...
-
Marketing and Data Specialist
4 weeks ago
alappuzha, India Future Midwest Investments Full timeSalary is Rs 3,50,000 - Rs 5,50,000 / year. A bachelor’s degree in Engineering, Math, or a related field is preferred. Company DescriptionFuture Midwest Investments is a privately owned real estate holding company based in Chicago. Role DescriptionThis is a full-time remote position for a Marketing Specialist at Future Midwest Investments. The Specialist...
-
Senior Data Manager
1 week ago
Alappuzha, India IntraEdge Full timeData and Analytics Manager Experience: 10+yrs Location: Pune (Hybrid) We at Intraedge is looking for a Data and Analytics Manager who is accountable for the strategic governance and management of the data and Analytics framework and the full alignment with the different data teams in the portfolio. In this role, you will also initiate, implement, and monitor...
-
Civil Engineer
4 weeks ago
Alappuzha, India Lokmanya Multipurpose Co-Op. Society Ltd Full timeCivil Engineer job descriptionWe are looking for an innovative Civil Engineer to join our team! As a Civil Engineer at our Society, you will mainly be responsible for designing, developing and constructing a wide range of interesting projects.Your position will be very important as you will have a say in how the world looks like. You will be able to work in...
-
Material Science Engineer
1 week ago
Alappuzha, India Recykal.com Full timeWe are seeking a highly skilled Material Science Engineer to contribute to the development of advanced material identification systems through chemical composition analysis, spectrophotometry, and investigation of physical properties. The engineer will work closely with our AI and optical engineering teams to design systems that can accurately detect,...
-
Senior RF Optimization Engineer
3 weeks ago
Alappuzha, India NeerInfo Solutions Full timeRF Senior Optimization EngineerJob Duties and ResponsibilitiesDISH Wireless is seeking a skilled RF Senior Optimization Engineer to bolster ournational team. In this role, you'll directly work with the National RF optimization Team,collaborating closely with various cross-functional teams across the market. As a keymember of our team, you'll play a crucial...
-
RevSure AI | Senior Software Engineer
2 weeks ago
Alappuzha, India RevSure AI Full timeCompany DescriptionIntroducing the future of B2B attribution: RevSure, the ONLY enterprise-grade Full Funnel attribution AI solution for complex GTM motions.RevSure is a go-to platform for marketing trailblazers with bold pipeline and ROI goals, offering killer insights, spot-on predictions, and actionable recommendations. The platform empowers modern demand...
-
Insight Global | DevOps Engineer
7 days ago
Alappuzha, India Insight Global Full timeInsight Global is looking for a DevOps to join one of North American’s largest retail and wellness companies. The ideal candidate will be joining the Enterprise Platform Engineering team that is focused on the improvement and betterment of the GitLab platform. This role will require you to enable and empower people to solve problems as they are faced with...
-
Security Engineer
2 weeks ago
Alappuzha, India SRM Technologies Full timeNote: Only Immediate joinersJob Type: Security EngineerLocation: Perungudi, ChennaiJob Type: PermanentInterested candidates send your updated CV to nandhini.durai@srmtech.comJD• 6+ years Proven experience as a security operation manager or similar role• Knowledge of security frameworks, standards, and best practices• Experience with security tools and...
-
Java Software Engineer
3 months ago
Alappuzha, India Lead Masters AI Full timeCompany Description LeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...
-
Sr. Software Engineer
4 weeks ago
alappuzha, India 360 Cloud Solution Private Limited Full timeCompany Description360 Cloud Solution Private Limited, founded in 2022, is an IT Services and IT Consulting company based in India. The company offers dedicated resources in various skills including Salesforce, Vlocity, CRM, PeopleSoft, Oracle, Business Analyst, QA, DevOps, AWS, Azure, ServiceNow, UI/UX Developer, Front-end Developer, and Data Engineer. They...
-
Pinnacle | DevOps Engineer | alappuzha
4 weeks ago
alappuzha, India Pinnacle Full timeCompany Description Headquartered in Pasadena, Texas, Pinnacle is exclusively focused on helping industrial facilities in the oil and gas, chemical, mining, and water and wastewater industries better leverage their data to improve reliability performance. Pinnacle is privately held and has been consistently recognized for its growth by Inc Magazine, the...
-
Machine Learning Engineer
1 week ago
Alappuzha, India Programmers.io Full timeWe are looking for Power Electronic Engineer in Remote. here you can go through JD,Job Title: Power Electronic Engineer (Machine Learning) Location: Remote Experience Required: 6 - 13 Years The Power Electronics Machine Learning Engineer is expected to have an excellent and broad knowledge of computer science, machine learning and data management. They will...
-
Search Engine Optimization Executive
1 week ago
Alappuzha, India Businexperts Full timeCompany Description Businexperts is a healthcare specialization firm based in Kaithal that helps hospitals and clinics increase their market presence and generate leads through customized marketing strategies and AI. By leveraging data analytics and artificial intelligence, we develop targeted campaigns that resonate with potential patients and maximize...
-
GCP Lead Engineer
4 weeks ago
Alappuzha, India Innova ESI Full timeCompany DescriptionInnova ESI is a leading IT partner firm dedicated to providing innovative and sustainable IT solutions for digital transformation. With a global presence in USA, Canada, Mexico, India, and Singapore, we offer end-to-end data solutions to enhance business operations and enable growth. Our joint venture of Enterprise Solutions, Inc., USA &...
-
Senior Engineering Manager
4 months ago
Alappuzha, India Walmart Global Tech Full timeAbout TeamThe Import Synchronization Tool (IST) provides real-time visibility of Direct Import flows from the Suppliers to Consolidation Centers. It is a planning and visibility product that provides granular, daily, real-time visibility of Direct Import flows from the Supplier, Foreign Port, US Port until the In-land FSCs and helps synchronize the demand...
-
ML Engineer Intern
3 months ago
alappuzha, India Branch International Full timeBranch OverviewBranch delivers world-class financial services to the mobile generation. With offices in the United States, Nigeria, Kenya, and India, Branch is a for-profit socially conscious company that uses the power of data science to reduce the cost of delivering financial services in emerging markets. We believe that everyone, everywhere deserves fair...