Data Analyst Job Search

Data Analyst

ABSTRACT

METHODS

Libraries used:

• Pandas: data manipulation and analysis tool built on Python
• Numpy: library for the Python programming language, adding support for large, multi-dimensional arrays and matrices
• Matplotlib: comprehensive library for creating static, animated, and interactive visualizations in Python
• Seaborn: Python data visualization library based on matplotlib
• Folium: a powerful Python library that helps you create several types of Leaflet maps
• Plotly: interactive, open-source, and browser-based graphing library for Python
• Opencage.geocoder: an API that can be use to look up coordinates of places, and also find out the place a set of coordinates corresponds to
• Scikit-Learn: a predictive data analysis toolkit
• Yellowbrick: a suite of visual analysis and diagnostic tools designed to facilitate machine learning with scikit-learn.

Data Cleaning:

1. Remove 'Unnamed: 0' column --> .drop() method
2. Parse the Lower and Upper Bounds of Salary Estimate, Company Size, and Revenue for granular analysis --> for loop with .replace(), .split() and .strip() methods
3. Remove the "/n" in the Company Name column --> for loop with .split() method
4. Rows with -1, '-1.0', and '1' were in place in certain columns. It seems like these values were input in place as Null values. I replaced them relevant values in each respective column.
5. OpenCage Geocoding on the State column to obtain forward geocoding (text to lat/long) via a RESTful API.

Data Analysis & Visualizations

What are the top 20 industries hiring during COVID19?

• The top 2 industries (IT Services and Staffing & Outsourcing) make up 29% of all Data Analyst jobs with a non-null Industry label. My guess would be that a lot of hiring is done by an intermediary Staffing & Outsourcing company as opposed to the actual job Industry.
• Outsourcing is cost- and time-efficient since it keeps finances flexible, not fixed. In-house – Hiring new staff members don't come cheap. Companies would have to face financial challenges with fixed HR expenses and even intangible costs like time to hire a full-time team. Companies are cutting costs due to the COVID19.

What are the top 20 companies hiring during COVID19?

• As previously mentioned, the first 8 companies are employment and recruitment agencies. The only non-staffing companies are Apple, MUFG (Financial Services), Citi, Bank of New York Mellon, and Molina Healthcare. Apple is a major technology company that designs, develops, and sells consumer electronics, computer software, and online services. Financial institutions and healthcare are essential businesses, required to combat the unprecedented times of COVID19.

What is the distribution of a data analyst's salary?

• The lower and upper bound salary estimates are skewed right, meaning the mean is greater than the median.
• Overall, a Data Analyst can be considered a well paid role.

What are the top 20 industries hiring ordered by median salary?

• The box plots seem to be all over the place. News outlet, chemical manufacturing, hotels only have one point so it's not truly representative since it's one sample for each of those industries.
• Let's establish a baseline of minimum number of job listings per industry. We will set the cutoff at 15 since that accounts for 90% of non-null postings.

Lower Bound of Median Salary by Industries with at least 15 job postings

1. Biotechnology and pharmaceutical companies both produce medicines, but the medicines made by biotechnology companies are derived from living organisms while those made by pharmaceutical companies generally have a chemical basis. The industry accounted for more than $1.3 trillion in economic output, representing 4% of total U.S. output in 2017 alone.
2. According to Statista's IT Market Model, the global IT equipment market, which includes PCs and tablets, servers, and IT peripherals, had a size of $518 billion dollars in 2017.
3. Video games are a billion-dollar business and have been for many years. In 2020, the revenue from the worldwide PC gaming market was estimated at almost $37 billion, while the mobile gaming market generated an estimated income of over $77 billion.

• The top 3 industries are highly lucrative and ingrained in daily life. The absense of any of these industries will have an significant negative impact on society in terms of productivity and entertainment.
• These companies have competitive salaries since they want to attract the best talent and company longevity.

Upper Bound of Median Salary by Industries with at least 15 job postings

• Biotech and pharmaceutical industries typically require an terminal degree to conduct research and developement. In addition, they may need to obtain multiple certifications and hours of on-the-job training. These extra hours and committment to a terminal degree usually reflect the upper range of salary expectations.
• It's a known fact that tech giants such as Google, Facebook, and Apple, offer highly competitive salaries compared to lesser counterparts. This is highly reflective on their lucrative business and revenue.

What are the top 10 sectors by max revenue?

1. The Health and Medical Insurance sector, which is made up of carriers of private, group and public health, medical and dental insurance, is characterized by growth as a result of consistent increases in healthcare expenditure and medical cost inflation, in addition to a sharp decline in the uninsured rate.
2. In 2019, the mining sectors leading companies had a total revenue of approximately $692 billion dollars.
3. Aerospace & Defense's total sales revenue in 2018 exceeded $929 billion, an increase of 4.17% from the previous year. The impact of this growth has been substantial for the nation’s gross domestic product (GDP). In 2018 alone, A&D contributed over $374 billion to the GDP of the United States, representing 1.8% of the entire GDP.
4. In 2019, the telecommunication sector's leading companies had a total revenue of approximately $276 billion dollar.
5. Finance, retail, manufacturing, media, transportation, and pharmaceuticals are essential and each plays a role in everyday life.

What are the top 15 industries by max revenue?

• The top 15 industries can be deemed "essential businesses."
• Drug stores, grocery stores and supermarkets need to be open for sanitation supplies, food, and essential goods.
• Utilities, cable/TV/internet providers are the main sources for productivity since many companies are directing employees to work from home. Students of all ages are engaged in distance learning. Since shelter in place protocol, people turn to the internet and TV for entertainment.
• Public transportation is vastly utilized by millions of people in the United States especially in densely populated cities such as New York City, San Francisco, and Los Angeles.

Median Income vs. Upper Bound Salary

• For experienced analysts, the upper bound salary is much greater than the median income (2018) in the listes states.
• However, there are exceptions in Georgia, Ohio, and Utah. These may need more investigation since those states have less than 35 job postings. The small sample size could easily be skewed with outlier data which drags the median upper bound salary estimate down.

Which states offer the most data analyst roles?

• While Silicon Valley is the nation's leading technology-driven economy, there are many notable tech hubs in the US with exciting opportunities.

1. It's no surprise that California has the most job offerings due to its population, size, and location of Silicon Valley.
2. Austin, Texas is one of the upcoming tech hubs forming outside of Silicon Valley. The cost of living is much lower than Silicon Valley which attracts many college graduates and young professionals.
3. New York City is a global icon on the forefront of culture, finance, and media. Digital media platform, finance tech, and real estate are some of the few popular industries that employ data analyst roles.
4. Chicago, Illinois has roughly 6,000 tech companies with popular industries of fintech, healthtech, and big data.

Detailed Company Info by Rating

• This plotly scatter plot shows each company's rating along with location, industry, and lower bound salary.
• This could be helpful to provide insight based on company reviews which can save their applicaton process by elimination of poorly reviewed companies.

Clustering Regions of Data Analyst roles

1. Pacific Northwest - 81 jobs
2. Northern California | Silicon Valley - 306 jobs
3. Southern California - 325 jobs
4. Southeast Texas - 397 jobs
5. Colorado - 130 jobs
6. The Midwest - 225 jobs
7. Northeast - 655 jobs
8. The South - 133 jobs

Takeaways

1. As I am in the process of finding my first job as a data analyst, this project provided valuable insight that companies are actively hiring. Although big tech companies such as Uber, Airbnb, and LinkedIn exercised mass layoffs due to the COVID19. Many companies are cuttings costs to consolidate their spending since many are uncertain the length of shelter in place and looming residual effects on the economy. Tech giants such as Facebook and Google allowed their employees to work remotely until July 2021.
2. The top 2 industries actively hiring are staffing agencies which make up nearly 30% of all Data Analyst jobs with a non-null entry. Outsourcing is cost- and time-efficient since it keeps finances flexible, not fixed. In-house – Hiring new staff members don't come cheap. Companies would have to face financial challenges with fixed HR expenses and even intangible costs like time to hire a full-time team. Companies are cutting costs due to the COVID19.
3. Nearly half of the top 20 companies hiring (by listings) are recruitment agencies. The only non-staffing companies are Apple, MUFG (Financial Services), Citi, Bank of New York Mellon, and Molina Healthcare.
4. It's no surprise that California has the most job offerings due to its population, size, and Silicon Valley. Texas, New York, Illinois, Washington, and Colorado are flourishing tech hubs outside of the Silicon Valley.
5. People actively on the job hunt may refer to the company ratings plot to filter out desired companies.
6. For experienced applicants, the upper bound salary exceeds the median income of each associated states in 2017.
7. Northeastern America and Southeast Texas are flourishing tech hubs with the amount of opportunities compared to other region clusters.