120 Apache Hadoop jobs in Pakistan

General Summary:

As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drives digital transformation to help create a smarter, connected future for all. As a Qualcomm Software Engineer, you will design, develop, create, modify, and validate embedded and cloud edge software, applications, and/or specialized utility programs that launch cutting-edge, world class products that meet and exceed customer needs. Qualcomm Software Engineers collaborate with systems, hardware, architecture, test engineers, and other teams to design system-level software solutions and obtain information on performance requirements and interfaces.

Minimum Qualifications:

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
• OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 1+ year of Software Engineering or related work experience.
• OR PhD in Engineering, Information Systems, Computer Science, or related field.
• 2+ years of academic or work experience with Programming Language such as C, C++, Java, Python, etc.

Preferred Qualifications:

• 3+ years of experience as a Data Engineer or in a similar role.
• Experience with data modeling, data warehousing, and building ETL pipelines.
• Solid working experience with Python, AWS analytical technologies and related resources (Glue, Athena, QuickSight, SageMaker, etc.).
• Experience with Big Data tools , platforms and architecture with solid working experience with SQL.
• Experience working in a very large data warehousing environment, Distributed System.
• Solid understanding on various data exchange formats and complexities.
• Industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets.
• Strong data visualization skills.
• Basic understanding of Machine Learning; Prior experience in ML Engineering a plus.
• Ability to manage on-premises data and make it inter-operate with AWS based pipelines.
• Ability to interface with Wireless Systems/SW engineers and understand the Wireless ML domain; Prior experience in Wireless (5G) domain a plus.

Education:

• Bachelor's degree in computer science, engineering, mathematics, or a related technical discipline.
• Preferred Qualifications: Masters in CS/ECE with a Data Science / ML Specialization.

Principal Duties and Responsibilities:

• Completes assigned coding tasks to specifications on time without significant errors or bugs.
• Adapts to changes and setbacks in order to manage pressure and meet deadlines.
• Collaborates with others inside project team to accomplish project objectives.
• Communicates with project lead to provide status and information about impending obstacles.
• Quickly resolves complex software issues and bugs.
• Gathers, integrates, and interprets information specific to a module or sub-block of code from a variety of sources in order to troubleshoot issues and find solutions.
• Seeks others' opinions and shares own opinions with others about ways in which a problem can be addressed differently.
• Participates in technical conversations with tech leads/managers.
• Anticipates and communicates issues with project team to maintain open communication.
• Makes decisions based on incomplete or changing specifications and obtains adequate resources needed to complete assigned tasks.
• Prioritizes project deadlines and deliverables with minimal supervision.
• Resolves straightforward technical issues and escalates more complex technical issues to an appropriate party (e.g., project lead, colleagues).
• Writes readable code for large features or significant bug fixes to support collaboration with other engineers.
• Determines which work tasks are most important for self and junior engineers, stays focused, and deals with setbacks in a timely manner.
• Unit tests own code to verify the stability and functionality of a feature.

Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities.

To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies.

If you would like more information about this role, please contact Qualcomm Careers.

Job Responsibilities:
1. Design and Development of Data warehouse
2. Design, Development & Maintenance of Azure Data Pipelines using Azure Data Factory
3. Design and development of spark jobs using Data Bricks
4. Team Management and coordination with onsite to ensure the smooth running of business
5. Knowledge or experience with one or more BI tools (Power BI/Business
Objects/Tableau/MicroStrategy/Qlik etc).
6. Maintenance of presentation layer and access layer.

Qualifications Needed:
1. BS Software Engineer with 2-5 years of experience in working on BI and Data Mangement
projects.
2. Expertise of DB+DWH Design, Support and Maintenance.
3. Experience in writing Complex SQL as well as SparkSQL.
4. Proven experience with python and related frameworks
5. Proven experience on Data Bricks using pySpark
6. Expertise with Power BI.
7. Expertise with Azure Data Platform is a plus.
8. Generating detailed documentation.
9. Excellent communication skills.

10. Ability and willingness to learn.
11. Very strong analytical skills.
12. Experience in data analysis is a plus.
13. Ability to independently manage critical situations.
14. Should be a Team player.

Join to apply for the Data Engineer role at TenX .

Get AI-powered advice on this job and more exclusive features.

JOB SUMMARY:

Data Engineers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. They should be able to analyze and understand business data needs and design effective ETL/BI processes accordingly.

DESCRIPTION:

Data Warehouse /ETL

• Develop data models and data marts from various source systems.
• Develop and maintain ETL scripts to load data into staging areas, data warehouses, and data marts.
• Identify opportunities to utilize objects and code to reduce development effort and ensure consistent business rules.
• Identify opportunities for analysis and reporting solutions.
• Evaluate and select data modeling, BI, and data warehouse tools.
• Translate business requirements into technical data models and data marts.
• Understand key business drivers.
• Contribute to the development of the company's BI initiatives.
• Provide input on the overall BI strategy and communicate concepts to users.

Reporting & Drafting

• Document all development activities according to company standards.
• Support team members in a collaborative environment.
• Help establish standards and processes for BI data modeling.
• Communicate task status and issues effectively to project leads.

Requirements:

• Bachelor’s degree in computer science, BIT, BBIT, or related field; master’s preferred.
• 1-2 years of experience in data engineering or related fields with exposure to Big Data methodologies.
• Strong knowledge of RDBMS and SQL.
• Familiarity with ETL tools like Talend, Informatica, SSIS, or IBM Infosphere DataStage.
• Experience with Big Data technologies such as Hadoop, Cloudera, and Talend for Big Data is preferred.

• Associate

• Full-time

• Consulting, Engineering, and Information Technology

• IT Services and Consulting, Data Infrastructure and Analytics, IT System Data Services

Referrals increase your chances of interviewing at TenX by 2x.

Get notified about new Data Engineer jobs in Lahore, Punjab, Pakistan .

• Develop data sets, tools and processes used to maintain a common, data standard across the Bank.
• Translate the business requirements into technical requirements
• Analyse processes and technologies, contributing to the integration of new solutions.
• Define and document functional and non-functional user requirements and specifications.
• Develop source mapping matrix and other key artifacts and documents.
• Build physical data model from logical data model into data warehouse and data lake.
• Build data pipelines, ETL/ELT, data control & validation processes using ETL frameworks and data integration tools.
• Write and optimize complex SQL, Python, Shell script code for data pipelines that leverage relational and non-relational data.
• Perform unit testing, system integration testing and user acceptance testing.
• Deploy machine learning models developed by data scientists into production environment.
• Provide training and technical support to operations team and end users.
• Perform performance optimization and maintenance on data warehouse and data lake.
• Create and maintain technical documentation that is required in supporting solutions.

Data Engineer with 2+ years experience in AI, Python, SQL, Spark, Azure, Databricks. Skilled in scalable data infrastructure & pipeline design. English required.

• Bachelor’s degree in computer science, Engineering, or a related field.
• Minimum of 2 years of experience in data engineering, specifically in large-scale AI projects and production applications.
• Strong proficiency in Python, SQL, Spark, Cloud Architect, Data & Solution Architect, API, Databricks, and Azure.
• Deep understanding of designing and building scalable and robust data infrastructure.
• Experience with at least one public cloud provider.
• Strong understanding of system architecture and data pipeline construction.
• Familiarity with machine learning models and data processing requirements.
• Team player with analytical and problem-solving skills.
• Good communication skills in English.
• Optional:
• Expertise in distributed systems like Kafka and orchestration systems like Kubernetes.
• Basic knowledge in Data Lake/Data Warehousing/Big Data tools, Apache Spark, RDBMS, NoSQL, Knowledge Graph.

• Design, build, and manage data pipelines, integrating multiple data sources to support company goals.
• Develop and maintain large-scale data processing systems and machine learning pipelines, ensuring data availability and quality.
• Implement systems for data quality and consistency, collaborating with Data Science and IT teams.
• Ensure compliance with security guidelines and SDLC processes.
• Collaborate with Data Science team to provide necessary data infrastructure.
• Lead and manage large-scale AI projects, working with cloud platforms for deployment.
• Maintain and optimize databases, design schemas, and improve data flow across the organization.

“To be ILI” means traveling far to reinvigorate innovation. It symbolizes vocation, commitment, and passion. We are a dedicated taskforce focused on sensing and initiating innovation.

Like a lion in the wild, constantly hunting and alert, we stay focused and agile, unlike a lion in captivity which loses its hunting instinct due to guaranteed food supply.

We offer a steep learning curve, development opportunities, and a flexible, positive work environment.

Modern office with design furniture, rooftop terrace with city view.

Supportive, open-minded teammates. Enjoy after-work events, barbecues, excursions, and team gatherings.

Fresh fruits, professional coffee, smoothies, on-site gym, and yoga room for relaxation.

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from DOT LABS

At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.

Forward your resume to

Location: DHA Phase 2

Timing: 11:00 AM -8:00 PM (Onsite)

As an Associate Data Engineer, you will be responsible for designing and implementing data pipelines, maintaining our data infrastructure, and optimizing data storage and retrieval. You will work closely with other data engineers, data scientists, and stakeholders to ensure our data is reliable, accurate, and accessible.

Responsibilities:

- Design, build, and maintain scalable and efficient data pipelines using Airflow and Python

- Implement and maintain data storage solutions on AWS, such as S3 and Redshift

- Develop and maintain data infrastructure, including ETL processes, data warehousing, and data lakes

- Collaborate with data scientists to ensure data is clean, accurate, and readily available for analysis

- Optimize data retrieval and storage processes to ensure high performance and reliability

- Monitor and troubleshoot data pipelines and infrastructure issues

- Work with stakeholders to understand data requirements and implement solutions that meet their needs

- Stay up-to-date with the latest technologies and trends in data engineering

Requirements:

- Bachelor's or Master's degree in Computer Science, Engineering, or related field

- 1+ year of experience in data engineering, with a focus on designing and implementing data pipelines and infrastructure

- Strong skills in Airflow and Python, with experience in data manipulation, data integration, and data analysis

- Experience with AWS services such as S3, Redshift, EMR, and Lambda

- Experience with data warehousing and data modeling concepts

- Strong problem-solving skills and attention to detail

- Excellent communication and collaboration skills

If you meet these requirements and are passionate about data engineering, we would love to hear from you. Please apply with your resume and cover letter, and let us know why you would be a great fit for our team.

#dotlabs #data #dataanalysis #design #experience #python #dataengineering #datascientists #aws #lahorejobs

• Seniority level Entry level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at DOT LABS by 2x

Lahore, Punjab, Pakistan PKR100,000.00-PKR130,000.00 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

About Burq

Burq started with an ambitious mission: how can we turn the complex process of offering delivery into a simple turnkey solution.

We started with building the largest network of delivery networks, partnering with some of the biggest delivery companies. We then made it extremely easy for businesses to plug into our network and start offering delivery to their customers. Now, we’re powering deliveries for some of the fastest-growing companies from retailers to startups.

It’s a big mission and now we want you to join us to make it even bigger!

We’re already backed by some of the Valley's leading venture capitalists, including Village Global, the fund whose investors include Bill Gates, Jeff Bezos, Mark Zuckerberg, Reid Hoffman, and Sara Blakely. We have assembled a world-class team all over the U.S.

We operate at scale, but we're still a small team relative to the opportunity. We have a staggering amount of work ahead. That means you have an unprecedented opportunity to grow while doing the most important work of your career.

We want people who are unafraid to be wrong and support decisions with numbers and narrative.

• Design, build, and maintain efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt, with a focus on integrating with Snowflake.
• Manage and optimize data warehousing solutions using Snowflake, ensuring data is organized, secure, and accessible for analysis.
• Develop and implement automations and workflows to streamline data processing and integration, ensuring seamless data flow across systems.
• Collaborate with cross-functional teams to set up and maintain data infrastructure that supports both engineering and analytical needs.
• Utilize Databricks and Spark for big data processing, ensuring data is processed, stored, and analyzed efficiently.
• Monitor data streams and processes using Kafka and Monte Cristo, ensuring data quality and integrity.
• Work closely with data analysts and other stakeholders to create, maintain, and optimize visualizations and reports using Tableau, ensuring data-driven decision-making.
• Ensure the security and compliance of data systems, implementing best practices and leveraging tools like Terraform for infrastructure management.
• Continuously evaluate and improve data processes, staying current with industry best practices and emerging technologies, with a strong emphasis on data analytics and visualization.

• Proficiency in SQL and experience with data visualization tools such as Tableau.
• Hands-on experience with data engineering tools and platforms including Snowflake, Airbyte, Airflow, and Terraform.
• Strong programming skills in Python and experience with data transformation tools like dbt.
• Familiarity with big data processing frameworks such as Databricks and Apache Spark.
• Knowledge of data streaming platforms like Kafka.
• Experience with data observability and quality tools like Monte Cristo.
• Solid understanding of data warehousing, data pipelines, and database management, with specific experience in Snowflake.
• Ability to design and implement automation, workflows, and data infrastructure.
• Strong analytical skills with the ability to translate complex data into actionable insights, particularly using Tableau.
• Excellent problem-solving abilities and attention to detail.

Investing in you

• Competitive salary
• Medical
• Educational courses

Generous Time Off

At Burq, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

About Burq

Burq started with an ambitious mission: to simplify the complex process of offering delivery through a turnkey solution.

We built the largest network of delivery partners, making it easy for businesses to plug into our network and start offering delivery services. Currently, we power deliveries for some of the fastest-growing companies, from retailers to startups.

We are backed by leading venture capitalists, including Village Global, with investors like Bill Gates, Jeff Bezos, Mark Zuckerberg, Reid Hoffman, and Sara Blakely. Our team is composed of world-class professionals across the U.S.

While we operate at scale, we are still a small team with a significant growth opportunity. This presents an excellent chance for you to develop your career while contributing to impactful work.

We seek individuals unafraid of being wrong, who support decisions with data and narrative. Here’s an overview of your responsibilities:

Some of the responsibilities

• Design, build, and maintain scalable data pipelines using tools like Airbyte, Airflow, and dbt, with a focus on Snowflake integration.
• Manage and optimize data warehousing solutions with Snowflake, ensuring data security, organization, and accessibility.
• Develop automations and workflows to streamline data processing and integration for seamless data flow.
• Collaborate with cross-functional teams to establish and maintain data infrastructure supporting engineering and analytics.
• Utilize Databricks and Spark for big data processing, ensuring efficient data storage, processing, and analysis.
• Monitor data streams and processes with Kafka and Monte Cristo to ensure data quality and integrity.
• Work with data analysts and stakeholders to create, maintain, and optimize visualizations and reports using Tableau for data-driven decisions.
• Ensure data system security and compliance, applying best practices and tools like Terraform for infrastructure management.
• Continuously evaluate and improve data processes, staying updated with industry best practices and emerging technologies, especially in data analytics and visualization.