Optional P Training Instructions: Fill & Download for Free

Not at all! In fact, machine learning — particularly deep learning — is so voraciously hungry for resources that the entire industry is scrambling to build faster hardware[1], more powerful APIs[2], more computationally efficient algorithms[3] , more compact representations of parameters[4] , more memory efficient network architectures[5] , more optimized data ingestion pipelines[6] , and faster systems for distributing and scaling the training[7] .With all that effort being spent to produce any speedup in training time, it raises the question: “Why is the community still reliant on a slow language like Python for constructing these models?”To answer that question, let’s take a deeper look into the architecture of the world’s most popular deep learning framework — TensorFlow[8] . As the question suggests, TensorFlow does indeed appear to be written in Python. But is that really an accurate thing to say?The important thing to make note of in this diagram is the separation between the client layer — which can be Python, C++, or even a number of other languages like Java — and the kernel layer written in C.The purpose of the client layer is pretty simple. It does two things:Defines the model as a graph of operations.Initiates execution of the graph through something called a session.And that’s basically it. You’ll notice that nowhere does the client — the Python code — actually do any tensor computation, or training, or networking calls. You can think of it a bit like a compiler. It creates a blueprint explaining what needs to be done, but it’s not responsible for actually doing it. That job falls to the kernel layer.Even with eager execution enabled, the Python code is not responsible for executing operations directly, only initiating the request for an operation to be executed, and synchronizing on its completion. This is similar to the model used by PyTorch, which also separates its API layer (Python) from its execution layer (C++).The kernel layer is where the magic happens, and yes, it’s written in C — not Python. Indeed, just about any time someone wants to write an API in Python they want to be fast, they write it as an extension module in C/C++.TensorFlow is no exception. When you construct an operation in TensorFlow, the actual implementation of that operation is most often written in C, not Python.But wait, it gets even better! If you have access to specialized hardware like GPUs (which, if you’re at all serious about deep learning, you absolutely must), it’s likely your operation isn’t even being executed on the CPU at all. Rather, it’s being executed on the GPU using low level APIs like cuDNN.These days, many neural network operations have become standardized. What cuDNN does is take many of these common operations — convolution, pooling, normalization, activation — and move them directly to the GPU. It doesn’t even matter what language you’re using, because the actual computation is happening on a different device entirely.Then there’s distributed training. Much like distributed computing in a system like Hadoop or Spark, the promise of distributed training is nearly 1:1 linear scaling: for every increase of N additional compute resources, the training throughput should increase with O(N).I work on a system called Horovod that does just this, scaling to 90% of the ideal up to hundreds of GPUs. Though the interface is again written in Python, the underlying execution happens in C++, using MPI and NVIDIA’s NCCL API where available.Despite having multiple Python processes communicating one another, none of the communication is actually happening as Python instructions, rather everything is delegated to a lower level API, be it C++ (MPI) or the GPU (NCCL).To sum up, here’s why the language choice of Python doesn’t matter for the purposes of making machine learning training fast and performant:Python defines the blueprint of work to be done, but does not execute the computation directly.Specialized hardware and APIs like cuDNN move computation to GPUs, making language choice irrelevant for such operations.Adding additional GPUs and machines using distributed training frameworks like Horovod allow training to scale to be 10x or 100x faster, regardless of language choice.In other words, it comes down to knowing your bottlenecks. Python’s role in the process is very minimal, adding up to only seconds at most of execution time in most cases, whereas total training time for deep learning models can run for hours or even days.So focus on improving the part of the system that will give you the greatest return on your investment.Footnotes[1] http://Tensor Cores in NVIDIA Volta GPU Architecture (https://www.nvidia.com/en-us/data-center/tensorcore/)[2] NVIDIA cuDNN[3] r/MachineLearning - [P] 50% Faster Machine Learning - Big Data Algorithms 1st Edition Completed! :)[4] Gradient Compression[5] State of the Art in Compressing Deep Convolutional Neural Networks[6] uber/petastorm[7] uber/horovod[8] TensorFlow Architecture  |  TensorFlow

Presenting you Ms.Arunima Sinha !Me : So, how many of you know about her !?*Very few hands are being raised here & there*Me : Well, Here goes her story then !Arunima Sinha, a former national volleyball and football player, boarded the Padmavat Express train at Lucknow for Delhi on 12 April 2011, to take an examination to join the CISF. She was pushed out of a general coach of the train by robbers wanting to snatch her bag and gold chain. Recounting the incident, she said:“Since they couldn’t take me on one at a time, each grabbed a limb and hauled me out the train. I flew into an oncoming train and the force threw me onto the opposite tracks. What happened thereafter took a matter of seconds. Before I could move my left leg off the track, a train went over it.Much later, when Mahila Ayog demanded a report, it was discovered that 49 trains had passed me by as I lay wrecked and bleeding on the tracks. Rodents would come and feast on my oozing wounds, scampering off when trains came. I kept screaming in pain before finally passing out. Looking back, I really wonder how I managed to hold on for so long. I never thought I would survive that night. But when morning dawned, renewed hope surged through me.Open tracks transform into public toilets for poor villagers who have nowhere else to defecate. The next morning when the lads came to take a dump, the sight of my mangled body greeted them. I was to be taken to the Bareilly District Hospital. But the move involved so many bureaucratic hurdles from disinterested government employees that I was left on the platform for hours before being taken to the hospital.My leg had to be amputated from below the knee immediately to prevent gangrene from setting in. I was losing blood alarmingly. Here that I was informed that the hospital was out of anaesthesia. With no choice, I instructed them to go ahead with the amputation. The limb was sawed off while I was fully conscious.The hospital staff were severely encumbered by the lack of supplies, but did everything in their power to make my suffering lessen. The pharmacist B.C. Yadav donated his own blood because there was none to spare. To give you an idea of the kind of hospital and place it was, I need to mention this. After the amputation, as I lay in the OT, a street dog ventured into the room and started feasting on the leg that had just been removed from my body.”She was offered compensation of ₹25,000 (US$390) by the Indian Sports Ministry. Following national outrage, the Minister of State for Youth Affairs and Sports Ajay Maken announced an additional Rs. ₹200,000 (US$3,100) compensation as medical relief, together with a recommendation for a job in the CISF. Indian Railways also offered her a job.On 18 April 2011, she was brought to the All India Institute of Medical Sciences[10] for further treatment, spending four months at the Institute. She was provided a prosthetic leg free of cost by a private Delhi-based Indian company.“Stories started circulating that I was travelling without a ticket and had jumped to avoid being caught by the ticket collector. A CCTV footage showed me standing in a queue to purchase the ticket. With this theory invalidated, even louder claims that I wanted to commit suicide started doing the rounds” she says.Arunima claimed that the police were lying. Contrary to the police claims the Lucknow bench of Allahabad high court ordered Indian Railways to pay a compensation of ₹500,000 (US$7,800) to Arunima Sinha.While still being treated in the All India Institute of Medical Sciences, she resolved to climb Mount Everest, She was inspired by cricketer Yuvraj Singh and television shows , who had successfully battled cancer, "to do something" with her life.Straight out of the hospital I went to see Bachendri Pal, the first Indian woman to climb Everest. Aside from my immediate family, she was the only person to not dismiss my mission. But she didn’t sugar coat it either. She told me, “Arunima in this condition you made such a huge decision. Know that you have already conquered your inner Everest. Now you need to climb the mountain only to show the world what you are made of.”Thereafter, Arunima did a basic course from the Nehru Institute of Mountaineering, the best school of its kind in Asia. This was followed by 18 months of rigorous training. She climbed smaller, but no less dangerous mountains, had a couple of near death experiences and underwent mind numbing, exhausting, spirit crushing pain. she supported herself with a grant from NIM. Then Tata Steel provided her with a generous sponsorship that let her focus exclusively on the impossible task that lay ahead.“My prosthetic limb posed some unique problems. The ankle and heel would constantly swivel as I tried to climb, causing me to lose my grip often. My right leg was held together by a steel rod. Any pressure sent up spasms of acute intense pain. My Sherpa almost refused to accompany me, assuring me that I was on a suicide mission. Most regular folks don’t stand a chance against the mighty mountain. What did I stand?Every climber has to traverse four camps on route to the peak. Once you’ve reached camp four, there’s 3500 feet to the summit. This area is known as the death zone, notorious for the number of lives it has claimed. There were bodies of erstwhile climbers strewn all around. A Bangladeshi climber I met earlier breathed his last right before me. Ignoring the cold fear in the pit of my stomach, I trudged on. Our bodies behave according to how we think. I firmly took stock of my fears and told my body that dying was not an option. But all that changed once I reached the summit.She started her expedition on 1st April, 2013 and reached the summit of Mount Everest on 21st May 2013- exactly after 52 days.Earlier My Sherpa had informed me that my oxygen supply was critically low. “Save your life now so that you can climb Everest again later,” he said pragmatically. I said, “If I don’t climb Everest now, my life will not be worth saving.” I erected the flag of my country on the peak, deposited some pictures of my idol Swami Vivekananda next to it. Then I used the last vestiges of my oxygen to take pictures and videos of myself on the peak. I knew I was probably going to die. So it was important that the visual proofs of my achievement make it down to the world. Fifty steps later, my oxygen finished.I have little patience for wonders of faith, destiny, kismet and the like. We chart our own destiny. It is my firmest conviction that luck will favour those who have the drive and the tenacity to win. As I lay suffocating and gasping for breath, I came across an extra cylinder of oxygen. My Sherpa quickly latched it on me. Slowly we embarked on the precarious downward climb. Far more deaths occur on the downward climb that the upward one on Everest and now that I had survived the worst, it was time to tell my tale.& she became the first female Indian amputee to climb Mount Everest.“I was re-born at the summit of Mount Everest. In all, after climbing all these mountains, I have learnt the true meaning of resilience, confidence and leadership and above all, humility.”Arunima Sinha is now dedicated towards social welfare and she wants to open a free sports academy for the poor and differently-abled people. She is donating all the financial aids she is getting through awards and seminars for the same cause.The academy would be named Shaheed Chandra Shekhar Vikalang Khel Academy.She wrote the book "Born again on the mountain", launched by Prime minister of India Narendra Modi in December 2014.She was awarded Padma Shri, the fourth highest civilian award of India, in 2015. She is Awarded Tenzing Norgay Highest Mountaineering Award in India same as Arjun Award.Failure is not when we fall short of achieving our goals. It is when we don’t have goals worthy enough. She reiterate this small poem she wrote when the journey gets too blurry:“Rehne de aasma, zameen ki talash karRehne de aasma, zameen ki talash karSab kuch yahi hai, kahin aur na talash karJeene ke liye, ek kami ki talash kar.”Translation :Let the sky be and seek the earthLet the sky be and seek the earthAll is here, search not elsewhereTo live beautifully, seek life in dearth !Her aim was to climb all the continents' highest peaks and put the national flag of India.She has already done six peaks:1. Everest in Asia,2. Kilimanjaro in Africa,3. Elbrus in Europe,4. Kosciuszko, Australia5. Aconcagua in Argentina as the world's five highest peaks.6. Carstensz Pyramid (Puncak Jaya), Indonesia​.Nation salutes her impeccable achievements with pride !Take a bow !!Take a moment to appreciate her strong will power and bravery fighting against all the odds.Her inspirational speech :Despite having everything, we complain and find excuses for every small missing thing, which refrain us from reaching our goals.If a middle class girl like most of us could win the toughest phase of her life and achieve the impossible, why can’t we !?Think about it ! :)So, whenever you are feeling low in life, just remember her name. Hope, you will get enough motivation to move forward !! :)*A standing ovation by audience for her & reverberation of claps all over…*Thanks for your time :)Source : Google, Wikipedia, blogs, etc.Arunima Sinha - WikipediaArunima Sinha Biography: Female amputee to climb Mount Everest - Making Peace with LifeHow the worst tragedy of her life turned Arunima Sinha into a world championBeing Thrown Off A Train Did Not Stop Her From Climbing Mount Everest, With An Artificial Leg!P. S :Latest update : She becomes world’s first woman amputee to climb highest peak of Antarctica on Jan 4th,2019. Keep going champ !! :)Arunima Sinha becomes world's first woman amputee to climb highest peak of Antarctica - The South Asian Express

1I think of the MBTI as 4 of the 6 steps of the intelligent process.People use both choices, but most people have a stronger preference for 1 or 2 step for their pattern. Hence, you get a Visual>N>J.All this is linked to the most important step - Goals - which actually correlate strongly to the preferences of the other 5.2So, in that way, what you describe is people will different preferences at those 2 steps. This is common and what I teach positive persuasion (selling).a)In the J/P, you are taking about the Deciding step. Your parent preference Now - Decisive J=Judging. Heck, that sound like lots of parents with young children. A parent gets used to saying ‘don’t touch the stove’ - all Now Deciding.It seems possible that a child a) by nature thinks about waiting - Open-Options P=Perceiving. Or just plain rebels that since the parent always makes a choice, the child trains to wait - waiting for the parent.I can only speak for raising my 4 children, I am not a professional. I only speak to how I sell for my business. But, in selling, I worked that Decisions should only occur 2% of the time. The majority is on action.In words, the Deciding step Decisive is the word ‘will’ and especially the Imperative tense with its hidden “{You will] . . . don’t touch the stove”. We wrongly are taught that that ‘will’ and such is the Future Tense is incomplete. Only ‘It will . . . rain.” is about the future, all other uses is people telling you the decision is made. Also, Absolutes like “I cannot talk now.” means not more - the Decision is made. There is not use arguing. Now, the helping verbs and the verbs what tell you in which step you and the other person are in the conversation. Listen for the words, and you can tell when the selling goes off track.My success is listening and guiding conversation via the 6 steps - in an order that I teach, and choosing the pattern (MBTI + 2) that make receiving easier.I am very, very literal and mechanical - sorry if you are not that type.b)In the N/S, you are taking about the Evaluating step.Pattern-Matching N=Intuitive is a totally different approach than Structure S=Sensing.My children I trained for both. By attaching the reason to every decision, they got the thinking pattern appropriate for the decision at hand. Sometimes, we go through lists (structure) - did you get permission, did you follow instructions. Sometimes, you use comparisons (N). I uses both, and that leads to success. I think that being able to communicate to both types is more important to selling.Your parent preference Pattern-Matching N=Intuitive is part of Piaget’s progress at about 8 years hold from just Structure (Concrete stage). I loved his book, and he is a real child psychologist.