9 Etl Processes jobs in Pakistan

Principal Software Engineer

The Platforms organization at Fanatics is at the heart of our company's data-driven decision making, building foundational capabilities that empower our application/data engineers and data scientists to unlock the power of data. We work relentlessly on enhancing the fan experience with exciting projects across a diverse landscape, including:

1. Commerce Applications: Architecting and designing D2C and B2B commerce applications with workloads distributed across a multi-cloud topology to engage fans around the world.
2. Storage Infrastructure: Building and managing scalable and reliable data storage solutions.
3. Streaming Data Processing: Handling real-time data pipelines with high throughput and low latency.
4. Data & Workflow Orchestration: Coordinating complex data processing workflows with efficiency and reliability.
5. Messaging Infrastructure: Ensuring secure and efficient communication between applications.
6. Big Data Processing: Analyzing massive datasets with speed and accuracy.
7. Data Warehouse: Providing a centralized and accessible repository for historical data.
8. Real Time OLAP Databases: Enabling fast and interactive data analysis for insights on the fly.
9. AI & ML Platforms: Building and maintaining a robust platform that supports the development and deployment of impactful ML models to power applications in areas such as recommender systems and inventory intelligence.

The Opportunity

We are seeking a passionate and experienced Principal Engineer to play a key role in shaping the future of our application, cloud, and data platforms at Fanatics. As a technical leader in the organization, you will be responsible for driving technical innovation, leading large initiatives, and mentoring junior engineers. You will have the opportunity to contribute to building scalable solutions that will empower our entire company to make data-driven decisions and operate more effectively.

Responsibilities

1. Design and drive the technical roadmap for the evolution of our platforms, ensuring they are scalable, reliable, and meet the evolving needs of the business.
2. Lead large initiatives within the broader Fanatics tech org, collaborating effectively with cross-functional teams including engineering, data science, and product management.
3. Provide mentorship and guidance to junior engineers, fostering their growth and development within the team.
4. Build data platforms that promote standardization, including data pipeline development, platform tooling, data lake formatting, and data democratization.
5. Build and maintain the AI/ML infrastructure to support Fanatics' AI/ML needs, with a focus on standardized MLOps practices, accelerating the adoption and deployment of impactful AI/ML applications across the company.
6. Champion data and AI governance best practices, establishing and enforcing data processing principles, design patterns, and practices.
7. Build strong cross-functional partnerships with teams across the organization, influencing them to adopt best practices and collaborate effectively.

Qualifications

1. 13+ years of experience leading the development of modern cloud-based applications and their integration into a common data platform (or data mesh) to enable business intelligence and optimization.
2. Deep technical understanding of distributed systems architecture and the integration of operational systems with analytical systems to enable anomaly detection, business process mining, and optimization at scale.
3. Strong expertise in the big data ecosystem, including tools like Apache Kafka, Spark, Iceberg, Airflow, AWS S3, data modeling, data warehouses, OLAP databases, etc.
4. Proven experience in data processing, orchestration, data engineering, data quality management, and data governance.
5. Excellent communication skills, with the ability to collaborate effectively across teams and provide clear and concise technical guidance.
6. Experience with AI/ML platforms and a working knowledge of how data scientists leverage data for AI is a strong plus.

Fanatics is building a leading global digital sports platform. We ignite the passions of global sports fans and maximize the presence and reach for our hundreds of sports partners globally by offering products and services across Fanatics Commerce, Fanatics Collectibles, and Fanatics Betting & Gaming, allowing sports fans to Buy, Collect, and Bet. Through the Fanatics platform, sports fans can buy licensed fan gear, jerseys, lifestyle and streetwear products, headwear, and hardgoods; collect physical and digital trading cards, sports memorabilia, and other digital assets; and bet as the company builds its Sportsbook and iGaming platform. Fanatics has an established database of over 100 million global sports fans; a global partner network with approximately 900 sports properties, including major national and international professional sports leagues, players associations, teams, colleges, college conferences and retail partners, 2,500 athletes and celebrities, and 200 exclusive athletes; and over 2,000 retail locations, including its Lids retail stores. Our more than 22,000 employees are committed to relentlessly enhancing the fan experience and delighting sports fans globally.

Overview:
We’re looking for a hands-on Data Science & Engineering Lead to lead our data strategy and help scale a lean, high-impact team. This role blends leadership, architecture, and deep technical work - from building predictive models to designing the infrastructure that powers real-time decision-making. You’ll partner closely with cross-functional teams (Product, Business, Finance, Tech) and take full ownership of analytics delivery from raw data to actionable insight.

This is a builder’s role - ideal for someone who wants deep ownership, startup pace, and the chance to grow as we scale.

Responsibilities:

• Define and deliver our data strategy - from core infrastructure to insights delivery
• Build and mentor a team of 2–5 data scientists and engineers
• Design and deploy predictive models, recommendation systems, and performance analytics
• Architect, deploy, and maintain scalable data pipelines and analytics tooling
• Own and scale robust data pipelines and ensure data integrity across business verticals
• Collaborate closely with stakeholders across Product, Business Finance, and Tech teams to integrate data into daily operations and product decisions
• Act as the go-to person for data strategy, experimentation, and insights
  
  
  
  
  

• 5–6 years of relevant experience in data science, engineering or analytics,
• At least 1-2 years in a leading or mentoring small teams (leading 2-5 people) within an agile high tech environment
• Strong command of Python or R; strong SQL skills required
• Deep expertise in data analysis, predictive modeling, designing scalable pipelines, and maintaining analytics infrastructure
• Familiarity with modern BI tools (e.g., Looker, Metabase, Power BI, Tableau)
• Experience working cross functionally with business and product teams
• Startup mindset; strong bias for action, autonomy and ownership; able to apply agile principles and own delivery end to end
  
  
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Engineering and Information Technology
• Industries Hospitality, Food and Beverage Services, and Retail

Referrals increase your chances of interviewing at Soum by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Get AI-powered advice on this job and more exclusive features.

Position holder (Manager - Technology) responsibility of managing our Finance systems, including OFSAA (Oracle Financial Services Analytical Applications), Financial Consolidation, and Regulatory Reporting. The Position holder will play a crucial role in designing and maintaining the finance system architecture that supports these business finance function. This role holder will help in maintaining the data models, ETL tools such as Informatica, and most importantly OFSAA data model. The job holder will be responsibility to manage hybrid team (onshore/Offshore) and supporting business stake holder management.

Key Result Areas

• Data Management: Design, develop, and maintain the data infrastructure that supports the Finance systems, ensuring data accuracy, integrity, and availability.
• Data Modeling: Apply data modeling techniques to design efficient and scalable data structures that support the Finance systems' reporting and analysis requirements.
• ETL Development: Utilize ETL tools like Informatica or like extract, transform, and load data from various sources into the Finance systems, ensuring smooth and accurate data flow.
• Finance System Management: Collaborate with Finance stakeholders to understand their data requirements and ensure that the data infrastructure meets their needs for financial consolidation, regulatory reporting, cost allocation, and profitability reporting.
• Project Management: Experience in managing finance technology projects, ensuring timely delivery with adherence to budgets.
• Communication and Stakeholder Management: Strong communication skills to interact with various stakeholders, including senior management, technical teams, and business users.
• Data Mapping: Perform data mapping exercises to align data from diverse sources to the standardized OFSAA data model, ensuring data consistency and accuracy.
• Data Quality and Governance: Implement data quality and governance processes to maintain high data quality standards across the Finance systems.
• Performance Optimization: Identify and implement performance optimization techniques to ensure efficient data processing and reporting within the Finance systems.
• Integration: Collaborate with IT teams and external vendors to integrate new data sources and applications with the Finance systems.
• Regulatory Compliance: Thorough understanding of regulatory reporting requirements and compliance standards in the banking industry.

Operating Environment, Framework and Boundaries, Working Relationships

• Operates within a fast-paced, dynamic technology landscape, ensuring alignment with the bank's strategic objectives and compliance with regulatory requirements.
• Adheres to internal policies, legal regulations, and ethical standards, with clear boundaries for decision-making authority to manage risks effectively and maintain confidentiality.
• Collaborates closely with cross-functional teams, senior management, and external stakeholders to drive technology initiatives and foster a culture of innovation and continuous improvement.

Problem Solving

• Developed and implemented data-driven solutions that increased operational efficiency through automating processes and optimizing data collection methods.
• Collaborated with cross-functional teams to integrate data from multiple sources, resolving discrepancies.

Decision Making Authority & Responsibility

• Managed data governance and quality control decisions, ensuring data accuracy and integrity for all reporting and analytics processes.
• Drove decisions on data collection and methodology, ensuring high-quality data was available for accurate processing and reporting.

Knowledge, Skills and Experience

• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proven experience as a Data Engineer, handling Finance systems like OFSAA, Financial Consolidation, and Regulatory Reporting.
• Expertise in data modeling techniques and ETL tools (e.g., Informatica) to manage data integration and transformation processes.
• Knowledge of banking finance functions, including financial consolidation, cost allocation, and profitability reporting.
• Familiarity with big data technologies and their applications in data management and analysis. Understanding of Hadoop architecture, tools like HDFS, Hive, Sqoop, Spark is critical for the tool.
• Proficiency in SQL and database management systems.
• Analytical mindset with a focus on data accuracy and attention to detail.
• Strong problem-solving skills and the ability to work independently as well as in a team environment.
• Excellent communication and collaboration skills to engage with stakeholders across different teams.

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Finance and Information Technology
• Industries Banking

Referrals increase your chances of interviewing at Mashreq by 2x

Karachi Division, Sindh, Pakistan 2 days ago

Karachi Division, Sindh, Pakistan 4 days ago

Karachi Division, Sindh, Pakistan 1 month ago

Karachi Division, Sindh, Pakistan 3 days ago

Karachi Division, Sindh, Pakistan 4 days ago

Karachi Division, Sindh, Pakistan 11 months ago

Karachi Division, Sindh, Pakistan 4 days ago

Karachi Division, Sindh, Pakistan 1 year ago

Karachi Division, Sindh, Pakistan 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

If you are a software engineering leader ready to take the reins and drive impact, we’ve got an opportunity just for you.

As a Director of Software Engineering at JPMorgan Chase within the Chief Data & Analytics Office's Data Governance Engineering team, you will play a pivotal role in supporting the firm in delivering services to clients and advancing the firm-wide agenda for Data & Analytics. You will lead firm-wide initiatives through a unified Data Analytics Platform, in alignment with the firm's Data & AI strategy. Collaborating with engineering teams, you will be responsible for creating designs, establishing best practices, and developing guidelines along with scalable frameworks to effectively manage large volumes of data, ensuring interoperability, compliance with data classification requirements, and maintaining data integrity and accessibility. You will work closely with Product & Engineering teams to promote unified engineering execution across multiple initiatives, strategically designing and building applications that address real-world use cases. Your expertise in software, applications, technical processes, and product management will be essential in promoting complex projects and initiatives, serving as a primary decision-maker and a champion of innovation and solution delivery. As part of the Product Delivery team, you will design and build scalable cloud-native foundational data governance products and services that support the Data Risk Pillars, providing a unified experience through the CDAO platform.

Job responsibilities

• Collaborate with product and engineering teams to deliver robust firm wide data governance solutions that drive enhanced customer experiences.
• Provides critical day-to-day leadership and strategic thinking, working with team of engineers and architects to align cross-functional initiatives, ensuring they are feasible both fiscally and technically.
• Makes decisions that influence teams’ resources, budget, tactical operations, and the execution and implementation of processes and procedures.
• Champions the firm’s culture of diversity, equity, inclusion, and respect
• Will be leading the consolidation and convergence effort of the Data Governance capabilities under unified CDAO Platform and other priority firmwide initiatives related to BCBS 239, data lineage, controls & data quality.
• Enable engineering teams to Develop, enhance, and maintain established standards and best practices, Drive, self-service, and deliver on a strategy to operate on a build broad use of Amazon's utility computing web services (e.g., AWS EC2, AWS S3, AWS RDS, AWS CloudFront, CloudWatch, EKS)
• Identify opportunities to improve resiliency, availability, secure, high performing platforms in Public Cloud using JPMC best practices.
• Implement continuous process improvement, including but not limited to policy, procedures, and production monitoring and reduce time to resolve. Identify, coordinate, and implement initiatives/projects and activities that create efficiencies and optimize technical processing.
• Measure and optimize system performance, with an eye toward pushing our capabilities forward, getting ahead of customer needs, and innovating to continually improve.
• Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Graph DB and Open Source RDBMs databases, Container Orchestration services including Kubernetes, and a variety of AWS tools and services.

Required qualifications, capabilities, and skills.

• Formal training or certification on software engineering concepts and 10+ years applied experience. In addition, 5+ years of experience leading technologists to manage, anticipate and solve complex technical items within your domain of expertise.
• Experience in building or supporting environments on AWS using Terraform, which includes working with services like EKS, ELB, RDS, and S3.
• Strong understanding of business technology drivers and their impact on architecture design, performance, and monitoring best practices.
• Dynamic individual with excellent communication skills, capable of adapting verbiage and style to the audience at hand and delivering critical information in a clear and concise manner.
• Strong experience in managing stakeholders at all levels.
• Strong analytical thinker with business acumen and the ability to assimilate information quickly, with a solution-based focus on incident and problem management.
• Hands-on experience with one or more cloud computing platform providers
• Experience in architecting for private and public cloud environments and in re-engineering and migrating on-premises data solutions to the cloud.
• Proficiency in building on emerging cloud server less managed services to minimize or eliminate physical and virtual server footprints.
• Experience with high-volume, mission-critical applications and their interdependencies with other applications and databases.
• Proven work experience with container platforms such as Kubernetes. Strong understanding of architecture, design, and business processes. Keen understanding of financial and budget management, control, and optimization of public cloud expenses. Experience working in large, collaborative teams to achieve organizational goals. Passionate about building an innovative culture.

Preferred qualifications, capabilities, and skills

• Bachelor’s /Master’s degree in Computer science or other technical, scientific discipline
• Experience implementing multi-cloud architectures anddeep understanding of cloud infrastructure design, architecture, and cloud migration strategies.
• Demonstrated proficiency in technical solutions, implementing firm wide solutions and experience in data governance vendor product knowledge is a plus.
• Certifications in target areas (AWS Cloud/Kubernetes etc.)
• Experience leading Data Governance and Data Risk Reporting platforms is a preferred.

2 weeks ago Be among the first 25 applicants

Job Title: Senior Data Integration Consultant

Location: DHA Phase 5, Lahore, Pakistan.

Position Type: Full-time (On-site)

Remote option for this role is not available.

Immediate Joining: 7 days (Notice Period)

Job Summary:

We are seeking a highly skilled Senior Data Integration Consultant with extensive expertise in data integration, ETL processes, and data warehousing. The ideal candidate will have hands-on experience in SQL Server Integration Services (SSIS) and SQL Server Reporting Services (SSRS), along with a deep understanding of data warehouse design, implementation, and best practices. This role will be instrumental in designing, implementing, and optimizing data integration solutions that support our clients' business intelligence and analytics objectives.

Key Responsibilities:

1. Data Integration & ETL Development:

• Design, develop, and implement data integration workflows using SSIS, ensuring robust and scalable ETL solutions.
• Manage ETL processes to ensure accurate data extraction, transformation, and loading (ETL) into data warehouses from various source systems.
• Monitor and troubleshoot data integration workflows to optimize performance and maintain data integrity.

2. Data Warehouse Design and Implementation:

• Collaborate with data architects and stakeholders to design comprehensive data warehouse solutions tailored to business requirements.
• Lead the implementation of data warehouse structures, including fact and dimension tables, star and snowflake schemas, and optimized data storage solutions.
• Ensure data warehouse performance meets operational and analytical needs through effective design and optimization strategies.

3. Reporting and Data Visualization:

• Utilize SSRS to develop and maintain a suite of reports that support business decision-making and provide actionable insights.
• Collaborate with business users to understand reporting requirements and translate them into well-structured, high-quality reports.

4. Data Quality and Governance:

• Implement data quality checks within ETL processes and data warehouses to ensure data consistency and accuracy.
• Collaborate on data governance initiatives to establish standards and ensure adherence to best practices in data management.

5. Collaboration and Stakeholder Communication:

• Work closely with data engineers, analysts, and business users to understand data requirements and deliver high-impact solutions.
• Serve as a subject matter expert on data integration and ETL, providing guidance on best practices and technical approaches.

Qualifications:

• Education: Bachelor's or master’s degree in computer science, Information Technology, Data Science, or a related field.
• Experience: Minimum of 6-8 years of experience in data integration, ETL processes, and data warehousing, with demonstrated expertise in SSIS and SSRS.

Technical Skills:

• Advanced proficiency in SSIS for ETL and SSRS for reporting solutions.
• Hands-on experience with data warehouse design and implementation, including dimensional modeling, schema design, and performance optimization.
• Familiarity with other ETL tools (e.g., Informatica, Talend) and cloud data integration platforms is a plus.
• Proficiency in SQL, data modeling, and relational database management.
• Knowledge of data governance and quality assurance practices.

Soft Skills: Excellent communication, problem-solving, and analytical skills, with the ability to work collaboratively across departments and with diverse stakeholders.

Share your resume:

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology

Referrals increase your chances of interviewing at BITS Global Consulting by 2x

Get notified about new Senior Data Consultant jobs in Lahore, Punjab, Pakistan .

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.

This position requires extensive SQL experience and a strong background in PySpark development.

Certifications in Azure Data Fabric: DP-600 / DP-700

Data Engineering:

• Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
• Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
• Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
• Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.

Documentation:

• Document ticket resolutions, testing protocols, and data validation processes.
• Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.

Ticket Management:

• Monitor the Jira ticket queue and respond to tickets as they are raised.
• Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
• Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks) as needed to resolve issues.

Troubleshooting and Support:

• Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
• Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.

Seeking a candidate with 5+ years of Dynamics 365 ecosystem experience with a strong PySpark development background. While various profiles may apply, we highly value a strong person-organization fit.

Our ideal candidate possesses the following attributes and qualifications:

• Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
• Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
• Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
• Hands-on experience with PySpark for data processing and automation.
• Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within the customers secure environments.
• Some experience with Azure DevOps CI/CD IaC and release pipelines.
• Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
• Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
• Experience with Data Engineering in Microsoft Fabric.
• Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks).
• Certifications in Azure Data Fabric: DP-600 / DP-700

• Opportunity to work with innovative technologies in a dynamic environment where progressive work culture with a global perspective where your ideas truly matter, and growth opportunities are endless.
• Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
• Enjoy the flexibility to work from anywhere.
• Work-life balance that suits your lifestyle.
• Competitive salary and comprehensive benefits package.
• Career growth and professional development opportunities.
• A collaborative and inclusive work culture.