365 Data Science is an online educational career website that offers the incredible opportunity to find your way into the data science world no matter your previous knowledge and experience.
Originally from KDnuggets https://ift.tt/2DZwzfL
Machine learning is fast becoming one of the most important developments in the software industry. Although this cutting edge technology…
Continue reading on Becoming Human: Artificial Intelligence Magazine »
Via https://becominghuman.ai/the-future-of-machine-learning-8245e14458df?source=rss—-5e5bef33608a—4
source https://365datascience.weebly.com/the-best-data-science-blog-2020/the-future-of-machine-learning
And there was a man, in a cave, held captive and hooked up to an electromagnet plunged deep in his chest. Hammering his way through, quite literally, Stark, built his initial Arc Reactor and Mark 1 Iron Man suit, using nothing but a bucket of scrap and modern, tactical, self-guiding, explosive payload-carrying arrows, ergo missiles. Over-did it, didn’t I? Mesmerizing to most, the primitive propulsion system for un-guided flight and rudimentary weapons were not striking to engineers like us.
Stark kept going on, adding new capabilities to his armour, reaching peak performance with the Model Prime and finally calling it a day with the Mark 85. (More like Captain Marvel blasted him in Civil War 2 or the Gauntlet irradiated him, based on the cinematic or comic universe you prefer).
Just like arguably the best science-fiction-based inventor, I never stop with my creations and continue over-hauling for higher performance, ’cause I know that there will always be a higher ascension level to reach.
Computer Vision is a field with rapid progress; new techniques and higher accuracy coming out from various developers across the planet. Machines now have human-like perception capabilities, thanks to Deep Learning; with the ability to not only understand and derive information from digital image media but also create images from scratch with nothing but 0’s and 1’s.
Time and again, the higher tech-deities bring me at a point in this space-time continuum where I am faced with a conundrum. My team and I, back in our final year of college, were building a smart wearable for people with impaired vision, an AI-enabled extension of sorts to help the user with recognizing objects, recognizing people, and performing Optical Character Recognition; we called it Oculus. In all honesty, we did not rip it off from Facebook’s, Oculus Rift VR Headset and it was purely coincidental. The AI Engine was comprised of a multitude of classifiers, object detectors and image captioning neural networks running with TensorFlow and Python. With my simpleton knowledge of writing optimized code, everything was stacked sequentially, not allowing us to derive results in real-time, which was an absolute necessity of our wearable. Merely by running the entire stack on the GPU and using concurrent processes, I was able to achieve 30fps and derive real-time results.
Thus, this began my journey of being fast — real fast.
Fast forward two years to the present, I currently work as an AI Architect at Integration Wizards. My work predominantly revolves around creating a digital manifestation of the architecture I come up with for our flagship product — IRIS. Wondering what exactly IRIS does? (being Deadpool and breaking the 4th wall) To give you a gist, IRIS is a Computer Vision platform which provides our customers with the ability to quickly deploy solutions that monitor and detect violations. People counting and tracking with demographics, adherence to safety gear usage, person utilization, detection of fire, automatic number plate recognition and document text extraction are some of the features that come out-of-the-box. Typically, IRIS plugs into existing CCTV networks, rendering previously non-smart recording networks into real-time analytical entities. IRIS uses Deep Learning for it’s AI Engine but the architecture of the pipeline and the neural networks has seen many changes. My first notable architecture involved web technologies, like Flask and Gunicorn, to create APIs, that my worker threads could utilize. This ensured that the GPU was utilized in a better manner. However, this turned out to be moot when a large number of streams were to be processed.
1. Machine Learning Concepts Every Data Scientist Should Know
3. AI Fail: To Popularize and Scale Chatbots, We Need Better Data
The two primary hindrances were the API based architecture being a bottleneck under higher loads and the Object detection neural networks being heavy. For this, I needed something better, a better queue and processing architecture along with faster neural nets. Googling and surfing Reddit for a couple of days, I came across Apache Kafka, a publisher-subscriber message queue that is used for high data traffic. We retro-fit the architecture to push several thousand images per second from the CCTVs to the neural networks to achieve our analytical information. We devised another object detection model that was anchor-less and ran faster while retaining performance. Of course, the benchmark was against the infamous COCO dataset.
This increased our processing capability close to 200 fps on a single GPU.
Yes, you guessed it, I didn’t stop there. I knew that there was much more fire-power I could get; accessible but hidden in the trenches of Tensor cores and C++ (such a spoiler). The deities were calling me and my urge to find something better kept me burning the midnight fuel. And then, the pandemic happened.
WHO declared COVID-19 a global emergency — it ravaged through multiple countries and fear was being pushed down people’s throats; most offices transitioned into an indefinite work-from-home status and India imposed the world’s largest lockdown. Wearing masks and Social distancing was the new norm and everybody feared another Spanish flu of the 1900s. As an organization, we work with AI to be an extension of man, helping the human race to be better. Usage of face masks and social distancing needed enforcement and what better way to do it than with AI? Our stars aligned, the goals matched and we knew what we needed to build. The solution had to be light-weight and fast enough to run on low-end hardware or run on large HPC machines to analyze hundreds of CCTV cameras at once. For this, we needed an efficient pipeline and highly optimized models.
By now, I had a few tricks up my sleeve. IRIS’ pipeline now harnesses elements of GStreamer, which is an open-source, highly optimized, image/video media processing tool. TensorRT is something we used to speed up our neural networks on NVIDIA’s GPUs to properly utilize every ounce of performance we could push out. The entire pipeline is written with C++ with CUDA enabled code to parallelize operations. Finally, light-weight models — the person detector uses a smaller ResNet-like backbone and our Face Detector is just 999 kilobytes in size with a 95% result on the WiderFace dataset. Our person detector and Face Detector are INT8 and FP16 quantized making them much faster. With quantization and entire processing pipeline running on the GPU, amalgamating these together, IRIS’ new and shiny COVID-19 Enforcer ran at 1000 fps at peak performance for Social Distancing and 800fps for both Social Distancing and Mask Detection.
This allows us to deploy IRIS on smaller embedded devices to provide a cost-effective solution for retail-chains and stand-alone stores while letting us utilize multi-GPU setups to run on warehouses, shopping malls and city-wide CCTV networks making it easier to comply with and deny the spread of infection.
I am not done. Achieving one milestone allows me to mark a bigger and better goal. Artificial Intelligence is in its infancy and being at the forefront of making it commercially viable and available in all markets, especially India has been mine and my organization’s vision. The endgame is to have AI for all, where people, be it developers or business-owners, have the ability to quickly design and deploy their own pipelines. IRIS aims at being a platform to precisely empower individuals with that, with the intention to democratize Artificial Intelligence, making it not a luxury for the few, rather a commodity for all. Chiselling AI agents to be the best tool that man has ever known will be our goal, paving the future with a legion of Intelligent agents, not making the world cold, but making us a smarter race. Ain’t nobody creating Ultron!
Finally, my advice to you, whenever you feel you are at a standstill — Tatakai tsudzukeru, which is Japanese for keep fighting. 🙂
So I heard you can do Computer Vision at 30FPS; I can do 1000. was originally published in Becoming Human: Artificial Intelligence Magazine on Medium, where people are continuing the conversation by highlighting and responding to this story.
Today, companies that do not adopt advanced technologies are slowly becoming obsolete. The ability to transfer money globally is no longer…
Continue reading on Becoming Human: Artificial Intelligence Magazine »
What is the difference between a data analyst and a business analyst?
In smaller companies, the job titles are sometimes interchangeable, and both describe roles that involve analyzing data and systems. However, bigger organizations employ data analysts and business analysts to do one-of-a-kind tasks, which makes the difference between the two quite important to understand.
So, if you are just getting started, or transitioning from an unrelated field, this post will help you determine which job role suits you best and decide which career path to take.
The fundamental job of a data analyst is to tell enthralling stories with data that empower company leaders to make more informed, and better decisions. The data analyst responsibilities often include:
A business analyst uses data to inform calculated strategic business decisions. Moreover, business analysts could also hold job titles including management analyst, operations research analyst, or business data analyst. The typical duties of a business analyst include:
A Bachelor’s Degree in a related field is typically required for entry-level positions. Managers nonetheless strongly opt for applicants who have a Graduate Degree, like a Master’s Degree in Analytics for senior jobs. Furthermore, a Bachelor’s Degree in a field that has an emphasis on Analytical and Statistical Skills, such as Mathematics or Computer Science will certainly give you a competitive edge.
The standard is a Bachelor’s or a Master’s degree. Relevant fields of study include Business, Business Administration, Accounting, Management, Economics, Marketing, Computer and Information Science, as well as Statistics. You could also go for voluntary certifications, which are widely available now. Supplementing your education with computer science, and data science courses will certainly benefit your career.
Simply put, a good analyst should be creative and curious. You should not only have a robust ground in statistical methods, but also a critical mindset. Those will enable you to solve issues through an analytical and creative lens.
A data analyst is usually proficient in a specific programming language and has a working knowledge of others as well. Typically, analysts use languages like SQL, Python, and R for gathering and cleaning data, visualization of data, and statistical analysis.
Trial and error are required for effective data visualization. A successful analyst comprehends what graphs should be used, should be knowledgeable in scaling visualizations, and know which charts will best represent the data.
A data analyst should be able to convey findings clearly, whether to an audience or readers, or a small team of executives. The key to your success is strong communication skills.
First things first. You should be an excellent communicator to become a business analyst. That means you should be master of facilitating working meetings, listening to answers, asking good questions, and absorbing all that’s being said. In today’s world, communication doesn’t need to be face-to-face all the time.
Therefore, you have to be a strong communicator in a virtual scenario as well.
In general, business analysts should be well-versed in SQL, Power BI, Tableau, and Microsoft Excel, among other software. Furthermore, they should have a working knowledge of the technology in analytics. Nevertheless, the need for hard tech skills, in general, is lower compared to data analysts.
So, if you want to advance your business analyst career, the remarkable market differentiator is to develop an advanced knowledge of mathematics, computer science, and data analytics.
All projects encounter some problems. As a matter of fact, an entire project, in its essence, is a solution to an issue. At the topmost level, business analysts facilitate a shared comprehension of a problem, the solutions possible, as well as determine the project’s scope. You’ll also find business analysts in the middle of facilitating teams to resolve technical problems, especially when they involve negotiation between several technology stakeholders and organization.
It is the responsibility of a business analyst to evaluate a few alternatives before helping the team settle for one solution. When trying to determine the issue that should be resolved, a qualified business analyst should listen to the requirements of the stakeholder, consider those, and ask probing questions until the real need emerges and is understood. This is what makes evaluation and critical thinking skills paramount to new business analysts.
According to Glassdoor data, if you’re 1-3 years into your data analyst career, you can expect an average annual pay of $55,000.
As you reach 4-6 years of experience, your compensation will also go higher ($62,000 median annual salary).
If you’re new to the role (with 1 to 3 years of experience), you can count on $59,000 average pay. Once you’ve spent more time on the job, your median annual pay can reach $69,000.
Should you go for a data analyst job, or a business analyst job? If you are trying to weigh your options, consider the following factors:
Both roles would enable you to capitalize on your fondness and love of ‘all things data’. Furthermore, both would appeal to your rapport in problem solving. Both careers also would perfectly work in tandem with in-depth data science knowledge.
The business analyst and data analyst roles, however, require varying focuses and sets of skills, which make it necessary to carefully choose your path. Fortunately, there are plenty of industries, such as consulting or software development with lots of opportunities for both business and data analysts.
It’s truly all up to you to decide, and we hope this article will help you embark on the right career path.
If you’re considering a data analyst or a business analyst career, check out the complete Data Science Program today. Start with the fundamentals with our Statistics, Maths, and Excel courses. Build up a step-by-step experience with SQL, Python, R, Power BI, and Tableau. And upgrade your skillset with Machine Learning, Deep Learning, Time Series Analysis, Business Analytics, and Customer Analytics in Python. Still not sure you want to turn your interest in data science into a career? You can explore the curriculum or sign up for 15 hours of beginner to advanced video content for free by clicking on the button below.
The post Data Analyst vs. Business Analyst: What Is the Difference? appeared first on 365 Data Science.
from 365 Data Science https://ift.tt/31ZEX6A
Originally from KDnuggets https://ift.tt/34hlSj8
Originally from KDnuggets https://ift.tt/2FyeeGJ
Originally from KDnuggets https://ift.tt/3hcAKDd
Originally from KDnuggets https://ift.tt/34cUFye
Originally from KDnuggets https://ift.tt/2Q65iKV
365 Data Science