6 Data Pipeline jobs in Pakistan

Azure Data Integration Engineer (DP600/700)

Lahore, Punjab ITC WORLDWIDE

Posted 13 days ago

Job Viewed

Tap Again To Close

Job Description

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.

This position requires extensive SQL experience and a strong background in PySpark development.

  • Certifications in Azure Data Fabric: DP-600 / DP-700

Responsibilities

Data Engineering:

  • Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
  • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
  • Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
  • Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.

Documentation :

  • Document ticket resolutions, testing protocols, and data validation processes.
  • Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.

Ticket Management:

  • Monitor the Jira ticket queue and respond to tickets as they are raised.
  • Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
  • Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks ) as needed to resolve issues.

Troubleshooting and Support:

  • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
  • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.

Desired Skills & Requirements

Seeking a candidate with 5+ years of Dynamics 365 ecosystem experience with a strong PySpark development background. While various profiles may apply, we highly value a strong person-organization fit.

Our ideal candidate possesses the following attributes and qualifications:

  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within the customers secure environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
  • Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
  • Experience with Data Engineering in Microsoft Fabric
  • Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks).
  • Certifications in Azure Data Fabric: DP-600 / DP-700

Why Join Us?

  • Opportunity to work with innovative technologies in a dynamic environment where progressive work culture with a global perspective where your ideas truly matter, and growth opportunities are endless.
  • Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
  • Enjoy the flexibility to work from anywhere
  • Work-life balance that suits your lifestyle.
  • Competitive salary and comprehensive benefits package.
  • Career growth and professional development opportunities.
  • A collaborative and inclusive work culture.
This advertiser has chosen not to accept applicants from your region.

Data Engineering

Sindh, Sindh Xloop Digital

Posted 13 days ago

Job Viewed

Tap Again To Close

Job Description

Senior Data Engineer

Karachi

Full time

Remote

We are seeking an experienced Senior Data Engineer with strong expertise in Informatica Cloud to join
our data engineering team. In this role, you will be responsible for designing, developing, and optimizing
high-performance data pipelines and ensuring seamless data integration across cloud platforms. Your
technical expertise will help improve data flow and processing capabilities while supporting critical data
initiatives for the business.

Description

  • Develop and Maintain Data Pipelines: Design, develop, and maintain efficient data pipelines
    using Informatica Cloud, ensuring high performance, scalability, and data integrity.
  • Implement data integration solutions across multiple cloud platforms (AWS, Azure, GCP),
    ensuring seamless data movement and transformation.
  • Focus on building robust ETL pipelines to extract, transform, and load data from various sources
    into cloud-based storage and data warehouses.
  • Optimize the performance of data pipelines and integration processes to ensure speed,
    accuracy, and cost-efficiency.
  • Work closely with teams to implement data quality checks and ensure data integrity across the
    data pipelines
  • Identify and resolve issues in the data pipeline, and work to continuously improve processes for
    efficient data management
  • Collaborate with data analysts, data scientists, and other stakeholders to ensure the data
    pipelines support business analytics and decision-making.
  • Document all processes, data pipeline configurations, and troubleshooting steps for future
    reference and transparency.

Requirements

  • 5+ years of experience in data engineering, with strong hands-on experience in Informatica
    Cloud (Data Integration, Data Quality, etc.).
  • Extensive experience in designing and developing ETL pipelines and data integration workflows.
  • Strong knowledge of cloud platforms such as AWS, Azure, or Google Cloud, and their integration
    with data engineering solutions.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Customer Integration Data Transformation Specialist

NielsenIQ

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

Company Description

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Job Description

The Customer Success function is a cornerstone of NIQ Brandbank, playing a crucial role in customer onboarding, adoption, retention, development, and satisfaction for both Brandbank and Etilize solutions.

The Customer Integration function is a vital, client-facing component of NIQ Brandbank. It is responsible for managing the suite of solutions across both Brandbank and Etilize, including associated service levels. This function ensures the efficient ingestion and distribution of all relevant digital product content to meet the needs of our internal teams, stakeholders, customers, industry, and NIQ.

Job Purpose

The Client Integration Data Transformation Specialist is responsible for supporting the successful deployment of new and updated services. This includes managing standard and custom data feeds, creating custom Excel extracts, and integrating with GS1 data platforms. The role is pivotal in ensuring seamless data transformation and integration processes that meet client needs and project specifications.

Job Responsibilities

  • Bespoke Integration Delivery:

  • Participate in the delivery of bespoke integrations, whether client-specific or GDSN (Global Data Synchronization Network).

  • Support data mapping, testing, and deployment activities to ensure accurate and efficient data integration.

  • Work with detailed data specifications and customer requirements.

  • Project Management:

  • Meet project milestones and adhere to client specifications for both inbound and outbound projects.

  • Collaborate with project managers to ensure timely and successful project delivery.

  • Knowledge Maintenance:

  • Maintain up-to-date knowledge of Nielsen Brandbank and local GDSN data models and capture rules.

  • Continuously update skills and knowledge to stay current with industry standards and best practices.

  • Understand complex data mapping and transformation procedures.

  • Collaboration with Consultants and Developers:

  • Work closely with consultants and developers to create patches and changes that support bespoke data outputs.

  • Ensure that all changes are thoroughly tested and meet quality standards before deployment.

  • Data Transformation Logic:

  • Build out data transformation logic to ensure data is accurately transformed and integrated.

  • Identify test scenarios and create test data to validate the transformation processes.

  • Experience in the field of complex data transformation/mapping exercises.

  • Data Quality Assurance:

  • Ensure data quality is maintained throughout the transformation process to the NBB Product Library, GDSN Connector, and retailer sites.

  • Implement quality control measures to detect and correct data issues.

  • Supplier/Retailer Consultancy:

  • Provide consultancy services to suppliers and retailers to maintain the relevance and quality of data coverage.

  • Advise on best practices for data integration and transformation to meet bespoke and standard integration requirements.

  • Stakeholder Communication:

  • Maintain regular and effective communication with key stakeholders, including project managers, clients, and internal teams.

  • Provide updates on project progress, address any issues, and ensure alignment with project goals.

  • Effective communicator, verbally and in writing, in local and English languages.

Additional Information

Our Benefits

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on:LinkedIn |Instagram |Twitter |Facebook

Our commitment to Diversity, Equity, and Inclusion

NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center:

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Data Science & Engineering Lead

Soum

Posted 13 days ago

Job Viewed

Tap Again To Close

Job Description

Overview:
We’re looking for a hands-on Data Science & Engineering Lead to lead our data strategy and help scale a lean, high-impact team. This role blends leadership, architecture, and deep technical work - from building predictive models to designing the infrastructure that powers real-time decision-making. You’ll partner closely with cross-functional teams (Product, Business, Finance, Tech) and take full ownership of analytics delivery from raw data to actionable insight.

This is a builder’s role - ideal for someone who wants deep ownership, startup pace, and the chance to grow as we scale.

Responsibilities:

  • Define and deliver our data strategy - from core infrastructure to insights delivery
  • Build and mentor a team of 2–5 data scientists and engineers
  • Design and deploy predictive models, recommendation systems, and performance analytics
  • Architect, deploy, and maintain scalable data pipelines and analytics tooling
  • Own and scale robust data pipelines and ensure data integrity across business verticals
  • Collaborate closely with stakeholders across Product, Business Finance, and Tech teams to integrate data into daily operations and product decisions
  • Act as the go-to person for data strategy, experimentation, and insights




Requirements:

  • 5–6 years of relevant experience in data science, engineering or analytics,
  • At least 1-2 years in a leading or mentoring small teams (leading 2-5 people) within an agile high tech environment
  • Strong command of Python or R; strong SQL skills required
  • Deep expertise in data analysis, predictive modeling, designing scalable pipelines, and maintaining analytics infrastructure
  • Familiarity with modern BI tools (e.g., Looker, Metabase, Power BI, Tableau)
  • Experience working cross functionally with business and product teams
  • Startup mindset; strong bias for action, autonomy and ownership; able to apply agile principles and own delivery end to end



Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Full-time
Job function
  • Job function Engineering and Information Technology
  • Industries Hospitality, Food and Beverage Services, and Retail

Referrals increase your chances of interviewing at Soum by 2x

Sign in to set job alerts for “Data Science Specialist” roles. Senior Machine Learning Engineer (Personalization)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Data Science & Engineering Lead

Karachi, Sindh Soum

Posted 25 days ago

Job Viewed

Tap Again To Close

Job Description

Overview: We’re looking for a hands-on Data Science & Engineering Lead to lead our data strategy and help scale a lean, high-impact team. This role blends leadership, architecture, and deep technical work - from building predictive models to designing the infrastructure that powers real-time decision-making. You’ll partner closely with cross-functional teams (Product, Business, Finance, Tech) and take full ownership of analytics delivery from raw data to actionable insight.

This is a builder’s role - ideal for someone who wants deep ownership, startup pace, and the chance to grow as we scale.

Responsibilities:

Define and deliver our data strategy - from core infrastructure to insights delivery Build and mentor a team of 2–5 data scientists and engineers Design and deploy predictive models, recommendation systems, and performance analytics Architect, deploy, and maintain scalable data pipelines and analytics tooling Own and scale robust data pipelines and ensure data integrity across business verticals Collaborate closely with stakeholders across Product, Business Finance, and Tech teams to integrate data into daily operations and product decisions Act as the go-to person for data strategy, experimentation, and insights

Requirements:

5–6 years of relevant experience in data science, engineering or analytics, At least 1-2 years in a leading or mentoring small teams (leading 2-5 people) within an agile high tech environment Strong command of Python or R; strong SQL skills required Deep expertise in data analysis, predictive modeling, designing scalable pipelines, and maintaining analytics infrastructure Familiarity with modern BI tools (e.g., Looker, Metabase, Power BI, Tableau) Experience working cross functionally with business and product teams Startup mindset; strong bias for action, autonomy and ownership; able to apply agile principles and own delivery end to end

Seniority level

Seniority level Mid-Senior level Employment type

Employment type Full-time Job function

Job function Engineering and Information Technology Industries Hospitality, Food and Beverage Services, and Retail Referrals increase your chances of interviewing at Soum by 2x Sign in to set job alerts for “Data Science Specialist” roles.

Senior Machine Learning Engineer (Personalization)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Engineering Manager, Data Analytics (AI Reliability)

Motive

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

Who we are:

Motive empowers the people who run physical operations with tools to make their work safer, more productive, and more profitable. For the first time ever, safety, operations and finance teams can manage their drivers, vehicles, equipment, and fleet related spend in a single system. Combined with industry leading AI, the Motive platform gives you complete visibility and control, and significantly reduces manual workloads by automating and simplifying tasks.

Motive serves more than 100,000 customers – from Fortune 500 enterprises to small businesses – across a wide range of industries, including transportation and logistics, construction, energy, field service, manufacturing, agriculture, food and beverage, retail, and the public sector.

Visit gomotive.com to learn more.

About the Role:

We’re looking for an experienced and impact-driven Engineering Manager to lead a newly formed team focused on the reliability, robustness, and performance of our AI features and services. This team will play a critical role in ensuring our AI-powered features operate with high precision and consistency in production environments.

You will be responsible for building and growing a team of engineers and analysts focused on data analysis, debugging, root-causing production issues, and figuring out the long tail of failures and corner cases across our AI stack. You’ll partner closely with applied AI teams, product engineering, QA, customer success, and customer support to close the loop between real-world usage and in-field behavior and the performance of our AI systems.

Responsibilities:

  • Build, manage, and mentor a high-performing engineering team focused on AI system reliability.
  • Lead efforts to detect, diagnose, and mitigate failures and degradation across AI features in production.
  • Design tools, dashboards, and processes to surface anomalies, performance regressions, and edge cases.
  • Drive cross-functional initiatives to improve monitoring, observability, and data quality.
  • Oversee data analysis, annotation processes, and AI system workflows to improve model performance.
  • Develop and maintain technical documentation for AI workflows, ensuring clarity and efficiency.
  • Monitor key AI performance metrics and implement strategies for optimization.
  • Champion a culture of ownership, rigor, and continuous learning within the team.
  • Actively coordinate and share data insights with the research groups within Motive to improve product and customer experience.

Requirements:

  • 2+ years of experience managing high-performing engineering teams, preferably in AI, ML infrastructure, or production systems.
  • Strong understanding of AI feature development lifecycles, data pipelines, model debugging, and post-deployment validation.
  • Proven experience with root cause analysis, reliability engineering, or debugging complex distributed systems.
  • Strong analytical mindset and ability to dig deep into data to uncover insights.
  • Experience working cross-functionally with ML researchers, product managers, customer success and support teams, and data engineers.
  • Excellent communication and leadership skills; ability to drive clarity in ambiguous environments.
  • Proficiency in Python and SQL for data processing and reporting.
  • Flexible to work across PK - US time zones

Creating a diverse and inclusive workplace is one of Motive's core values. We are an equal opportunity employer and welcome people of different backgrounds, experiences, abilities and perspectives.

Please review our Candidate Privacy Notice here .

UK Candidate Privacy Notice here .

The applicant must be authorized to receive and access those commodities and technologies controlled under U.S. Export Administration Regulations. It is Motive's policy to require that employees be authorized to receive access to Motive products and technology.

#LI-Remote

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Data pipeline Jobs in Pakistan !

 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Data Pipeline Jobs