Automatic Resolution Of Ambiguous Terms Based On Machine: Fill & Download for Free

GET FORM

Download the form

How to Edit The Automatic Resolution Of Ambiguous Terms Based On Machine and make a signature Online

Start on editing, signing and sharing your Automatic Resolution Of Ambiguous Terms Based On Machine online following these easy steps:

  • click the Get Form or Get Form Now button on the current page to make access to the PDF editor.
  • hold on a second before the Automatic Resolution Of Ambiguous Terms Based On Machine is loaded
  • Use the tools in the top toolbar to edit the file, and the added content will be saved automatically
  • Download your modified file.
Get Form

Download the form

A top-rated Tool to Edit and Sign the Automatic Resolution Of Ambiguous Terms Based On Machine

Start editing a Automatic Resolution Of Ambiguous Terms Based On Machine straight away

Get Form

Download the form

A clear tutorial on editing Automatic Resolution Of Ambiguous Terms Based On Machine Online

It has become very simple in recent times to edit your PDF files online, and CocoDoc is the best online PDF editor you have ever seen to do some editing to your file and save it. Follow our simple tutorial to start!

  • Click the Get Form or Get Form Now button on the current page to start modifying your PDF
  • Add, modify or erase your text using the editing tools on the top tool pane.
  • Affter editing your content, put on the date and create a signature to make a perfect completion.
  • Go over it agian your form before you click to download it

How to add a signature on your Automatic Resolution Of Ambiguous Terms Based On Machine

Though most people are in the habit of signing paper documents by handwriting, electronic signatures are becoming more normal, follow these steps to sign documents online free!

  • Click the Get Form or Get Form Now button to begin editing on Automatic Resolution Of Ambiguous Terms Based On Machine in CocoDoc PDF editor.
  • Click on the Sign icon in the tool box on the top
  • A box will pop up, click Add new signature button and you'll have three options—Type, Draw, and Upload. Once you're done, click the Save button.
  • Move and settle the signature inside your PDF file

How to add a textbox on your Automatic Resolution Of Ambiguous Terms Based On Machine

If you have the need to add a text box on your PDF so you can customize your special content, do the following steps to complete it.

  • Open the PDF file in CocoDoc PDF editor.
  • Click Text Box on the top toolbar and move your mouse to carry it wherever you want to put it.
  • Fill in the content you need to insert. After you’ve put in the text, you can take use of the text editing tools to resize, color or bold the text.
  • When you're done, click OK to save it. If you’re not settle for the text, click on the trash can icon to delete it and start afresh.

An easy guide to Edit Your Automatic Resolution Of Ambiguous Terms Based On Machine on G Suite

If you are seeking a solution for PDF editing on G suite, CocoDoc PDF editor is a recommended tool that can be used directly from Google Drive to create or edit files.

  • Find CocoDoc PDF editor and install the add-on for google drive.
  • Right-click on a chosen file in your Google Drive and select Open With.
  • Select CocoDoc PDF on the popup list to open your file with and allow CocoDoc to access your google account.
  • Make changes to PDF files, adding text, images, editing existing text, annotate in highlight, give it a good polish in CocoDoc PDF editor before hitting the Download button.

PDF Editor FAQ

How different are C++ and Java?

Platform independency which gives PortabilityC++ is a Platform dependent language. So, C++ programs which are compiled on one machine can only run on that particular machine on which they are compiled making it not portable.Whereas Java is Platform Independent language. When java programs are compiled they are converted into some intermediate code termed as bytecode. Now, whichever machine has JVM application installed can execute already compiled source file without bothering about operating system at all making it portable.Free unused MemoryJava has automatic garbage collection as a named thread which is responsible for removing unused objects from the memory and which is automatically generated by JVM. So memory is automatically freed when not used any more.C++ has no automatic garbage collection. So, all unused reserved memory needs to be manually freed when no longer used to avoid memory leaks.PointersC++ supports pointers. You can explicitly declare the pointers which holds the address of another variable and you can pass the address of the variable.Java doesn't support pointers meaning that in java you cannot explicitly declare the pointers as you are able to do in C++.C++ compiled programs doesn't need any intermediate application to execute C++ programs. Whereas Java compiled programs needs JVM application to be installed to execute java programs.SecuritySince C++ program allows using pointers, it allows to get control over hardware using pointers and also it doesn't need any application to execute. So, we can develop viruses using C++ which is unsafe for computer.Java doesn't support pointers and java programs needs JVM application to be executed. So, Java language prevents this type of unsafe code.Multiple InheritanceC++ supports multiple inheritance because it has scope resolution operator(:) using which we can overcome "the ambiguity" happening during multiple inheritance.Java doesn't support multiple inheritance because a subclass constructor can make call to only one super class constructor and we can have only one super(); statement in a constructor body which leads to an ambiguity.With Respect to UsageJava is most likely to be found in Web and Enterprise applications, C++ is more likely to be found in System and other low level applications.ThreadingC++ has no built in support for threads. C++ relies on non-standard third-party libraries for thread support.Java has built in support and dedicated java.lang.Threads libraries for threading support.True/False ValueC++ considers all non-zero values as TRUE and 0 as FALSE.Unlike C++, an integer value expression cannot be placed where a BOOLEAN is expected in Java.Static Local VariablesUnlike C++, static local variables are not allowed in Java.Object SlicingUnlike C++, Object Slicing doesn't happen in Java. Because non-primitive types are always assigned by reference.Virtual FunctionUnlike C++, Functions are virtual by default in Java. So, run time polymorphism is present by default in java.Member initializationUnlike C++, in Java, members can initialized with declaration of class.Derived Method from base classC++ allows to give more restrictive access level specifier to methods derived from super class/ base class.Java doesn't allow to give more restrictive access level specifier to methods derived from super class/base class.Abstract classIn C++, if a class has at least one pure virtual function, then the class becomes abstract.Unlike C++, in Java, a separate keyword abstract is used to make a class abstract.ExceptionsIn C++, all exceptions are unchecked, so it is not forced by the compiler to either handle or specify the exception. It is up to the programmers to be civilized, and specify or catch the exceptions.In Java exceptions under Error and RuntimeException classes are unchecked exceptions, everything else under throwable is checked.Exception catchingIn Java, catching a base class exception before derived is not allowed by the compiler itself.In C++, compiler might give warning about it, but compiles the code.Exception throwingIn C++, all types (including primitive and pointer) can be thrown as exception.But in Java only throwable objects (Throwable objects are instances of any subclass of the Throwable class) can be thrown as exception.throws keywordIn Java, a new keyword throws is used to list exceptions that can be thrown by a function.In C++, there is no throws keyword, the same keyword throw is used for this purpose also.finally blockIn Java, there is a block called finally that is always executed after the try-catch block. This block can be used to do cleanup work.There is no such block in C++.goto statementUnlike C++, Java does not support goto statement.And...... ....... .........There are are lot many differences between C++ and Java.

What is Alexa Answers and what sociological and anthropological insights can be drawn by the questions?

What is Alexa Answers and what sociological and anthropological insights can be drawn by the questions?I have been conducting a statistical study of Alexa Answers [1] and what I found is quite astonishing. This results have a robustly impacts understanding of how people use Voice First [2] devices like Alexa from an anthropological, sociological and business perspective.Specimen of Alexa Answers Control Panel.Empirical Research Study On Alexa AnswersI was commissioned to conduct this research by a notable and very astute Sand Hill Road Venture Capital group. My report was a—mouthful with over 600 pages including some relatively unknown and somewhat obscure patent references. I have asked and was granted permission to post some of the insights as an answer to this Quora Question and have deep gratitude to them for allowing me to share a study that they paid very generously for. They agreed with me that there is an undiscovered continent ahead with how people are using Voice First devices at scale to not only surface hundreds of new business plans, based on the questions received by Alexa, but also a window into how people are using Alexa. We also have a window in to the human factors and phycology of interacting with a device that is conducting a limited anthropomorphic conversation in their home.I come to this subject from an interesting and somewhat biased perspective. I have been a top writer at Quora [3] for about 8 years and my work there was published at HuffPost, Slate, Forbes, Apple News, Gizmodo, Newsweek, Inc, Daily Mail, and Business Insider. Thus I not only know the power and utility of Question and Answer sites (Q & A), I also feel rather strongly Quora has continued to not only define the category but also continues to innovate at a rapid pace.This is a concatenation of a report that is ~600 pages. The report had a number of other goals other then to present how Alex Answers works. As with most of my commissioned reports I identify typically multi-billion dollar startup opportunities and true Clayton Christensen disruption, if this is indicated. I have isolated the elements related to Alexa Answers and Q & A Sites in general and how they are vitally important to the next 50 years in computer I call the Voice First revolution [4].History of Q and ATo understand how Alexa Answers in the context of current Q & A systems we will need to digress to surface fundamentally important aspects of successful systems. This is vitally important if the answering community survives and thrives. As we will explore, this is not a certainty.The Straight DopeThe first elements of the modern Q & A system was decidedly not technical but very popular, The Straight Dope newspaper column was first published in 1973 and syndicated around the US. The popularity was partly based on the obscurity of questions asked snd the detailed and creative way they were answered. In many cases the average person cold have looked up the question in a home encyclopedia or local library. Yet there was the element of how columnist Cecil Adams and illustrator Slug Signorino captivated and educated their regular growing reader base. The Straight Dope was still published up to June, 2018 when it started what may be a permanent hiatus.The Usenet OracleIn The Usenet Oracle was a 1989 attempt at the first Internet based Q & A site using a humorous Socratic style, it became a very popular pre-web area to find answers to questions that when completed were called an Oracularity. This established a sort of passive-aggressive answering style that today dominates all parts of the Internet today. Usenet, because it was text based and primarily used by people that worked in the computer and software industry using a 300-1200 baud modem helped progress the terse passive-aggressive Socratic style. For many reasons the Oracle fell out of use. One reason was the rise of the World Wide Web. Another reason was the culture of the community just about chased out any answerer that did not adopt the terse passive-aggressive Socratic style.ProfNetBy 1996 the commercialization of Q & A sites started with the launch of PR Newswire’s site called ProfNet, an online community of communications professionals made to provide reporters access to expert sources. Although I did read The Straight Dope and attended to Usenet nightly, I see my real first Q & A experience with ProfNet, where I answered 100s of questions centered around technology, payments and small businesses primarily. The site was used by reporters, lawyers and a fascinating array of government institutions where to this day, I still do not know what they do and found it important not to ask. The site ended as other professional experts sites surfaced at a lower price point and aimed directly to either reporters or the legal field.Google Question And AnswersIn the intervening years there were many segmented and subject matter focused Q & A sites that spring up and shuttered. Until 2001 with the start of Google Question And Answers was started. This service involved Google staffers answering questions by e-mail for a flat fee $3.00. It was fully functional for about 24 hours, after which it was shut down, possibly due to excessive demand and the tough competition from Yahoo. Determined, Google Answers was launched in April 2002. A month later, a search feature was added so users could read question and answer pairs.By late November 2006 Google reported that it planned to permanently shut down the service. The reason “We considered many factors in reaching this difficult decision, and ultimately decided that the Answers community's limited size and other product considerations made it more effective for us to focus our efforts on other ways to help our users find information.” Keep this reason in mind as it turns out to be rather important. The culture of the community began to decay over time for many reasons.Answer.comAnswer.com and sister site WikiAnswers started as an idealab project (and Answer . Com domain name) in 1996. Initially questions and answers were displayed through a downloadable software product, today known as 1-Click Answers. The product was launched as a free product in 1999. Beginning in 2003 it was sold to users on a perpetual license base and later as an annual subscription. The service suffered from a lack of proficient and quality answers and less then a very low customer base. By 2010 Answer.com launched its alpha version of a Twitter-answering service nicknamed 'Hoopoe.' When tweeting a question to the site's official Twitter account: AnswersDotCom, an automatic reply is given with a snippet of the answer and a link to the full answer page on the Answers website. The service suffered from a lack of use.Yahoo AnswersBy 2005 Yahoo established the first sustainable model to the modern Q & A site to some degree. The concept was simple: Yahoo Answers was a community-driven Q & A site or “a knowledge market” that allows users to both submit questions to be answered and answer questions asked by other users. This gave questioners and answers an equal footing. It turns out there are some people that are great at posing questions, some are rather fascinating and other people are great at either first person knowledge on the subject matter of the question or excel at researching an effective answer. Yahoo Answers had an early limited use version answered by Yahoo employees and contract workers called Ask Yahoo, but this had very little use and exposure.Yahoo established a standard in rights ownership: though the service itself is free, the contents of the answers were owned by the respective users. Yahoo maintained a non-exclusive royalty-free worldwide right to publish the information.Yahoo Answers was a study of the good, bad and ugly of Q & A sites. Yahoo Answers allowed any questions that did not violate Yahoo Answers community guidelines. But the guidelines were an ever changing moving target. It also magnified what we users of the Usenet knew all too well, the terse passive-aggressive Socratic style and the hidden agenda question and hidden agenda answer. Categories like Politics and Religion & Spirituality along with the typical “debunker” clans began to cause internal strife with users and Yahoo. The anonymity of the answerers helps to contribute to this environment, users could choose to reveal their Yahoo Messenger ID on their Answers profile page but even this was not a direct identity as some users had 100s of IDs.Yahoo initially started a points system to “gameify” misuse of Yahoo Answers. This was handled by a user moderation system, where users report posts that are in breach of guidelines or the Terms of Service. Posts were removed if they receive sufficient weight of trusted reports primarily from users with a reliable reporting history. Deletion could be appealed: an unsuccessful appeal receives a 10-point penalty; a successful one reinstates the post and reduces the 'trust rating' of the reporter. If a user receives a large number of violations in a relatively short amount of time or a very serious violation, it can cause the abuser's account to be suspended. In extreme cases for a Terms of Service violation, the abuser's entire Yahoo ID will be suddenly deactivated without warning.The point system also was implanted to encourages users to answer as many questions as possibly, up to their daily limit. Once a user achieves and maintains a certain minimum number of such contributions, they may receive an orange "badge" under the name of their avatar, naming the user a Top Contributor. Users could lose this badge if they do not maintain their level of participation. Once a user becomes a "Top Contributor" in any category, the badge appears in all answers, questions, and comments by the user, regardless of category. A user can be a Top Contributor in a maximum of 3 categories.The points system is weighted to encourage users to answer questions and to limit spam questions. There are also levels with point thresholds, which give more site access. Points and levels have no real world value, cannot be traded, and serve only to indicate how active a user has been on the site. A notable downside to the points/level system is that it encourages people to answer questions even when they do not have a suitable answer to give to gain points. Users also receive ten points for contributing the "Best Answer" which is selected by the question's asker. The voting function, which allowed users to vote for the answer they considered best, was discontinued in April 2014.The Yahoo Answer, Questions were initially open to answers for only our days. However, the asker can choose to pick a best answer for the question after a minimum of one hour. Comments and answers could still be posted after this time. To ask a question, one has to have a Yahoo account with a positive score balance of five points or more.The culture of the community of Yahoo Answers decayed as many of the top answerers moved to Wikipedia and Quora latter on in search of a better community and culture.QuoraThis Q & A site Quora was established in June 21, 2010 and received widespread acclaim very early on, especially praised for its interface and for the quality of the answers written by its users, many of whom were recognized as domain experts with first person knowledge in their respective fields. Quora's user base exploded almost instantly and, by late December 2010, the site was seeing spikes of visitors five to ten times its usual load—so much that the website initially had difficulties handling the increased traffic. When the website first came online and for many years afterward, Quora refused to show ads because, as the company stated in 2016, "...ads can often be negative for user experience. Nobody likes banner ads, ads from shady companies, or ads that are irrelevant to their needsQuora established community moderators as well as moderators employed by the company. Quora requires users to register with the complete form of their real names rather than an Internet pseudonym, although verification of names is not required, false names can be reported by the community. This was done with the intent of adding credibility to answers and to control abuse. Users with a certain amount of activity on the website have the option to write their answers anonymously but not by default.Quora can be thought of as an ongoing science experiment. The site has gone through a great deal of evolution. Each iteration surfaces from the tests of prior iterations. Quora has attributes from many of the Q & A sites that came before. For example Quora has developed its own proprietary algorithm to rank answers, which works similarly to Google's PageRank that gives priority and weighting to an answer along with up/down votes and other engagements like reads and comments.Quora has been by far the most successful Q & A site thus far with millions of questions and answers and over 300 million month visitors. The site’s answers are usually featured at the top of most search results and ranks as the top 128th site in the world.Quora is really the only general interest Q & A site success story and there are many reasons for this. To help guide to the scope of this discussion it is not a chicken/egg situation, the site always needs a deep and wide contingent of writers. The game mechanics and reward systems are vitally important and has contributed greatly to the site’s success.There are many elements that have motivated the most prolific writers on Quora. One of the fundamental ones comes down to distribution, a good answer could potentially be seen by hundreds of thousands of people.Another element is the elastic structure to the answers. Quora is not a Wikipedia rote restatement of “facts” and this is the fundamental strength of the site. If you made it to this point in this posting, you are experiencing it: the wide spectrum of elastic responses to a question.Quora thrives because of what I have come to understand personally, as the inventor of a new type of medium and long form writing. The terse passive-aggressive Socratic style tends not to survive at Quora because of this. Whereas a vast majority of Q & A sites were infected with minimalist answers and easy to notice snide elitism, Quora has flourished with writers that for the greater part know and love the subject matter of the domains they write about first hand.One of the most powerful secrets about Quora is just about any question either has been posed or can be posed (with-in the site guidelines. This allows for domain experts to flourish. This may seem like a minor element, but it is one of the reasons I have been active on the site for over a decade. Quora cares about the sacculated first person knowledge not so much the question, but the knowledge.Storytelling is the fundamental tool humans have to learn. Quora’s success is based on creating an environment where first person knowledge of the domain expert can craft a story about the subjects they have spent their lives on. Although not everyone may be a “great” writer from a technical perspective, somehow the passion that person has becomes shared with the knowledge and information. This inevitably becomes longer form writing.The culture and community at Quora is quite unlike any Q & A site I have participated in. There was a camaraderie from the very early days on to the most current era. There are many elements that have built the core group that carry this ethos forward, one is the comments section where users could interact with the answerer and ask more high resolution details about the question as well as to offer commentary and debate. Although not perfect, the real name elements of Quora has maintained a civil commentary and debate element.The Basis For A Successful Q & A ProgramWe have established a number of criteria for successful and less than successful Q & A sites. This is very important for the longevity of Alexa Answers as if they cann’t sustain consistent good answerers, the system would meet the same fate as other Q & A sites and fall into fiefdoms of despair.Quora and SiriIn April, 2010 a few days after Apple acquired Siri, I began to write about how vitally important site like Quora will become to the Voice First revolution. I wrote “Is Quora Important to Siri” [5} as an example of the opportunity.“Quora As A Best Source For SiriWe are at the precipice of a major shift on how we interact with our devices and the information that is in the cloud. In fact perhaps the entire electronic world controlled by these devices will see this shift.Siri is the first real step in this direction of the 4th user interface, not replacing the Mechanical User Interfaces (the keyboard, mouse and gestures) but enhancing them and perhaps creating an entirely new use case for instant knowledge. The model we had up until this point may in the near future seem somewhat clumsy and dated when used to get at simple end point data. It is perhaps the tasks that all of us have become accustomed to that will be the most stark noticeable difference we will be confronted with. To put it simply, most of us find it is easier to ask a question with our voice, then to go through a Mechanical process. In the old Mechanical User Interfaces model there are the obvious steps and the steps that are less obvious,”—Brian Roemmele Quora, 2010I also answered a recepicol answer Is “Siri important to Quora?” [6]. In 2011 I said:“Siri Will Need To Access The Entire InternetThis type of system is an enhancement to the Mechanical User Interfaces (Keyboard, Mouse, Gestures). But Siri is also far more then this, from a Meta view it is a system that will understand your words, extract intentent, create a plan to access the Domain APIs that will generate the information to either produce an answer or complete a task”—Brian Roemmele Quora, 2011Alexa Answers ResearchIn December 2018 Amazon launched the Q&A platform into beta with the goal of improving Alexa’s ability to answer questions. on September 12, 2019 Alexa Answers was live to all with an Amazon account. On the announcement Amazon said the feature was well-received by the early community of invite-only participants, who have contributed “hundreds of thousands of answers that have been shared with Alexa customers millions of times”.Specimen of the Alexa Answers website 2019To differentiate these answers from other Alexa responses, they’re attributed to “an Amazon customer” post-amble. This attribute brings along many positive and negative aspects we will surface later. However it is safe to say that this post-amble diminishes authority in the answer and Alexa as a system of authority as a whole.During the launch Amazon stated the basis for Alexa Answers was: “there are thousands of answers that had previously stumped Alexa, like ‘Where was Barbara Bush buried?’, ‘Who wrote the score for Lord of the Rings?’, ‘What’s cork made out of?’ and ‘Where do bats go in the winter?’”. It would seem that Alexa should have the ability to answer some of these questions based on Wikipedia searches or the default Bing searches.Some experts feel this is a Knowledge Graph problem and that if the Knowledge Graph was large enough all questions can be answered. This is the same thinking that assumes we will need General Artificial Intelligence or pass some Turing Test for useful Voice First AI, history will show this approach was painful wrong and painful obvious it was in hindsight.As mentioned you must have an Amazon account to participate in Alexa answers. This turns out to have a filtering effect of some bad actors and some abusive passive-aggressive type answers. Many answerers would likely not want to jeopardize their Amazon account with attributes of high negitivity. Even though you can choose not to use your real name in Alexa Answers, Amazon still knows who you are. Yet this element has a huge opportunity for Amazon beyond the the filtering effect, the answerers are also Amazon customers and obviously the shopping habit correlation is interesting, self released data, it also can be used to highly motivate good answers and good answerers in ways that space in this answer does not permit me to explore.Amazon has a history of crowdsourcing book and product reviews since its inception. This experience is both a blessing and curse as they do help the company, on the surface understand some elements of crowdsourcing ecosystems, it also creates the illusion that book/product reviews are somehow similar to answering a question, it will turn out not to be this case.Specimen of the daily bonus questions from Alexa Answers.Once signed in you will be presented with eight general categories of interest/expertise which will then generate a list of questions available. You can choose to filter them based on attributes like “most frequently asked,” or “newest” or by other category areas. You have just 150 characters to answer the proposed questions. It usually takes a few hours to be accepted by Amazon and published. This is easily considered short form questions and in most cases it is all the space we would need. However I discovered cases where this is clearly not the case and thus inaccurate or incomplete answers will result.My research shows that verbosity in response and if the user would find this a good response is based on the Myers-Briggs Indicator (MTBI) of the user. I started building MTBI aware systems in the late 1980s and can extract with high resolution the likely MTBI of the user and thus reflect a correlating MTBI of the persona and answers the Voice First system presents. We can see that although sounding complex just knowing and presenting the MBTI correlation of the user can make an answer more useful and can also help understand the meaning of a question in real-time.Specimen of Alexa Answers community leaderboards.After you submit an answer, you earn points toward monthly and weekly leaderboards and badges based on how many questions you’ve answered, how many times it’s been shared with Alexa users and more. This sort of game mechanics initially serve as a motiving force but for many it loses power over time as more people fill the system with answers. This is similar to the gameifaction used in Amazon Book/Product reviews. Amazon says:“This new feature is just one example of the many ways we’re continuously working to grow Alexa’s knowledge. As always, we’ll continue to evolve the experience based on customer feedback”.Specimen of Alexa Answers levels and points.Although game mechanics have a point in just about everything, they can also serve as a big distraction and cause actions that may not generate quality answers or answerers. We can learn a great deal form the errors of Yahoo and Google form this element.Specimen of Amazon Technical Turks website.I am told Mechanical Turks [7], an Amazon service used the same interface as Alexa Answers. It is interesting that prior to Alexa Answers Amazon paid Technical Turks to answer Long Tail questions. We can speculate if this was successful or not successful as a method. With Alexa Answers there are dashboard and leaderboards showing how much your answer was used by Alexa and how often it was “Star” rated is standard gameifaction. When an Alexa user is presented with the answer there is a random response after the post-amble that states “did you find this question useful”. the issue with this type of feedback is that it is really not a true form of feedback it is entirely situational and subjective. Complicating the gameifaction is the community of answerers can vote a 1 - 5 stars for your answer. It may also be automated by the game mechanics systems Amazon built to motivate better answers. However this is one area where potentially bad actors can form groups, and they do on all of the Q & A sites and vote down certain answers and certain answerers. This has a sort of chilling effect on the results that are generated. Additionally by not using a true Likert Scale [8], this is a type of rating scale used to measure attitudes or opinions, the binary helpful/not helpful is almost useless as it manifests as a thumbs up or thumbs down on the Alexa Answers dashboard next to the answer posted.I have found ways to perform a Voice First AI Likert test that is not obtuse or obvious as a post conversation the system uses to understand and create true feedback. And of course asking an overt 1-5 Likert would be not useful. Of course I do not overtly ask for a Likert score directly but I can arrive at one indirectly through follow up questions and answers.Specimen of the Likert Scale Questions In Textual Form.So we are stuck in a world of crowdsourced answerers judging of answerers and the answers they produce along with the binary “useful” or “not useful” vote by the user. Both signals are ambiguous beyond the obvious and overt incorrect or bad faith answer. Yet there are better ways to determine this beyond crowdsourcing.So on the surface this seems to be a very simple and straight forward Q & A system with Alexa questions serving as the basis for the answerers to respond to. Yet this is not nearly the same feedback loop that exists on successful long for Q & A sites like Quora. Although not immediately obvious to even people that are experts in this field, there exits a vital feedback loop that allows for a better answer. The quagmire starts with the fact this is a post processing result, meaning the original questioner will likely never ask the question again, for a number of reasons. Thus we have a brach in the taxonomy that may or may not bare any fruit. Now there are a number of ways for Amazon to solve this problem, but this is not the approach that will prove to be successful for many more reasons, this is just one.Thus Alexa Answers can be seen as best, as only a way to post process a question via crowdsourcing. In my analysis which we will explore later on, we will surface many examples of questions that will statically fall below the crucial “noise rate” below .01% likelihood. Even more interesting is the face many of the questions are in a format that can easily be answered by a protocol not the path Amazon and others take, I call “rote machine learning”. One way to understand this is how you recognize a bird. When you were first introduced to a bird you formed a protocol on what an ontology of living creatures are like. You further a taxonomy of bird-like over a very short period of hours to days. You did not need to see 10,000 images of a bird in various light settings for an array of reasons, many are related to the tens of thousands of protocols and sub-protocols that run anytime you are greeted with the new. Some think of this as pattern matching and that is a very low resolution way to present what is happening.This is part of systems I have built I call The Intelligence Amplifier [9] and one of the fundamental aspects of the system is to extract intents and meanings and thusly extract answers based on the protools indicated and the information the intelligent agents returned in real-time.BOOM!Meet https://t.co/qdKFgeC498 her first time heard in public. She is particularly adapt at surfacing information not found on the Internet or quite hidden.She is a 100% proactive system that uses a patented notification system.#TheIntelligenceAmplifier is many folks. pic.twitter.com/twolfpNkK1— Brian Roemmele (@BrianRoemmele) August 25, 2019Specimen of Agatha.Best one of The Intelligence Amplifiers performing research.The Perils OF The Voice First Fence LineFrom the user’s experience, when Alexa does not know an answer, a fence line is erected in the mind of the user each time they hear “I don’t know that” or “I cant do that” it is profoundly difficult to change the boundaries, once established after enough of these events. This is why most Voice First platforms will meet with issues that may cause extremely constrained use cases over time. It is also why the companies that build these platforms need to acquire very astute people that have understood this issue for decades, not just since 2008 or something. I call this empirical praxis and the hiring practices of all the companies that build Voice First platforms are usually limited to degreed computer engineers, AI engineers and linguists experts. There are exceptions but theses are the cohorts building these systems. There is absolutely nothing wrong with these professions, indeed they are needed, but there are hundreds of experts that would be shown the door before HR even has a chance to speak with them.How To Answer Any QuestionAlexa Answers was built with the premise that “long tail” questions require human respondents to extract meaning. It is an engineering solution to a human problem that is not fully understood by the engineer. It is classic ex post facto designing where the loop is never closed for the user. Thus we will have an ever widening array of questions that seem unique but have a protocol basis that could allow it to be answered in real time, with no knowledge graph or AGI. In fact this is precisely what I did. Using protocols I developed in The Intelligence Amplifier “I’ answered a few thousand questions across 16 test accounts (don’t ask how I established these active and legal Amazon accounts, but no ill will was involved). All of the questions were processed by the protocols and produced answers that were accepted by Amazon and distributed through the Alexa universe. In effect, The Intelligence Amplifier took questions Alexa could not usually in seconds. I just redirected the answers via a simple script back to Alexa Answers. I had to throttle the system as at some point 30 answers a minute would raise suspicion.I did manually answer a few questions to test the fence line and boundaries of the system. There were interesting artifacts I discovered in just the questions I answered and did not allow The Intelligence Amplifier to answer. In one case, that I can not publish the question or answer for a number of reasons, non are illicit in any way, just proprietary, I found that many “5 star” votes to this obscure answer and a 5 day delay before Amazon published it.I been building databases of questions typically asked since The Usenet Oracle in 1989. Thus with all the Q & A sites of have been a part of or conducted research, I have accumulated over 16 million questions and a percentage of answers. This has allowed me to empirically draw on over 30 direct research databases. I have conducted a longitudinal study of this research over the years and recently created a new study that includes what I have found with Alexa Answers.Ontologies And TaxonomiesThere can be all kinds of taxonomies in an ontology. however ontology attempts to describe and capture an entire subject area, with all of its complexity, whereas a taxonomy tries to simplify a complex collection of seemingly unrelated items into a linear, organization. We can think of the way Alexa’s category system works as an ontology, in as much as the actual question is captured in its complexity but it flows to eight taxonomies. In a real sense the top level of categories could be seen as a true taxonomy, I will use ontology labeling for a number of reasons. One reason is that each question could and should form a true ontology to be correctly answered by a correctly established protocol to categorize the elementals of the question so as to reuse it in future question / answer pairs.By far a significant number of short form resulting questions on the top of ontological tree can be directly based Wikipedia as the primary source. All of the Voice First platforms use Wikipedia resources and Wolfram Alpha as a typical answer source. In the case of Alexa, my research shows that the taxonomies flows from eight primary ontologies:VideoGeographyScienceHistoryMusicFoodLiteratureSportsInternally there may be more top level ontologies, but these are the eight ontologies that have been exposed currently during my research. Even a cursory overview will establish that the whole of possible questions can not be easily held in a top level ontology that Alexa appears to use. Thus the Science category has some odd additions forming a sort of “kitchen sink” catch-all for question categories that do not fit the very limited ontologies.Twenty three percent of the overall questions asked by Alexa users are in the Science and Food categories. It is important to understand there will be distortions in overall questions in as much the Alexa Answer questions show questions that in theory Alexa did not provide a useful answer for. However in my studies of Q & A sites I feel we have a rather robust cross section of Alexa question situations.The distribution of question ontologies do not completely reflect the relationships of the types of questions posed to Alexa, however we can use this data as a rather useful starting point.Specimen of research by Brian Roemmele on the distribution of 5000 questions on Alexa Answers.Why are these ontologies important? They serve two primary functions:In real-time the can establish a guide to the possible answers to ineffectually posed questions.In answer misses, they can serve to notify answers on Alexa Answer the category they selected.Consider the Science ontology, here are two specimen questions presented by Alexa Answers :A) What's the freezing temperature of ice?B) How many squirrels are left in the world?Although it is possible to categorize item B as “science” it is really more of a trivia sort of question that likely has no exact answer. By grouping these types of questions together, there limited ontologies get distorted. Most trivia question can have some statical science involved but they do not truly belong to the science tree. I use over 6000 top level ontologies based on some dozens of studies, real-life testing and the database of Q & A sites I have amassed.Consider this axiom:The fine detail to anything is just 90 steps away.How many times do I need to cut a Cherry Pie before I get to a single atom?It takes ~90 successive cuts.Although the long tail of questions look to be an endlessly complex problem, and to be sure it is if you use the approach every Voice First platform uses, it is reducible to the logical in less then 20 “cherry pie cuts”. And with context of the flow of questions before and other telemetries it can be achieved in many cases with 5 questions to the questioner. Thus if this sort of protocols were instituted, there would really be no need for human answerers in many cases.A Deep Statistical Study Of Questions Pose By Alexa UsersSo lets dive deeper in to the rich insights we can derive from Alexa Answers. There are many anthropological, sociological and business perspectives and insights I have drawn from my research. Although this is on going research the early results are nothing less then fascinating. Alexa Answers as a research tool offers astounding possibilities with the private questions of millions of users presented. Have no doubt they are deemed private questions because there is no overt preambles telling the Alexa user that the question they just posed would be seen by a crowdsourced answerer community. Now can one see anything particularly useful or personally identifiable? In a very limited case the answer is yes. It is not intentional by Amazon but an artifact of how they process and present questions. I will not publish what I discovered publicly, but it is not nearly a big concern, just a general one.To understand intent(s) and meaning(s) of the question we use a process that is engrained into our conscious and sub conscious. But it is designed to be nuanced by interaction and not typically binary Question Answer. To help currant AI systems extract intent and arrive at meaning we typically use a linguistic break down of sentence in to semantics. We use a Reed–Kellogg system or parse tree of the question and typically can be broken down by functional parts:subjectobjectadverbialverb (predicator).nounsThe subject is the owner of an action, the verb represents the action, the object represents the recipient of the action, and the adverbial qualifies the action. The various parts can be phrases rather than individual words and relate to people, places and things. We use a sentence diagram that is a pictorial representation of the grammatical structure of a sentence. The term "sentence diagram" is used more when teaching written language, where sentences are diagrammed. The term "parse tree" is used in linguistics (especially computational linguistics), where sentences are parsed. Both show structure of sentences. The model shows the relations between words and the nature of sentence structure and can be used as a tool to help recognize which potential sentence is actually a sentence.Simple sentences in the Reed–Kellogg system are diagrammed according to these forms:Specimen of the Reed-Kellogg system of parsing.The Intelligence Amplifier uses a meta parse tree indirectly based on the Reed Kellogg systems and establishes a first pass numeric determinism to the question and ultimately to the answer it presents via a feedback loop similar to Likert Scale and also context of preceding questions. The numeric values are:In band +1 - 9Out of band - 1 - 9Obtuse * 1 - 9Gibberish ? 1 - 9I use this scale along with ~92 others to help classify the ontologies and correctly extract intents and meanings. With out correct intent extraction and a road to meaning, the question and the answer is of course meaningless.The Alexa Answers Baseline StudyFor this paper I will use a sample set of ~5000 questions extracted from the Alexa Answers site over the period of 6 months in early 2019. A very curious insight I found early on, is that many questions actually have Alexa answers and they did not need crowdsourcing to arrive at an answer, and in and of itself, this is interesting.Here are some sample questions and the associated ontology Amazon applied:What's the perfect temperature to brew coffee at?Food +1How big is an atlas moth?Science +1Where do honey crisp apples grow?Food +1Did michael jackson go to college?Music +6What was captain kangaroo's real name?Video +1How tall was edward the first?History +1What is the average weight of a motorcycle?Science +7What country has the most females?Geography +9How long is cat's been on broadway?Video +4What is tiny turtles real name?Video +9How long is the continental united states?Geography -1Are sharks warm blooded?Science +1What's the name of robin hood's hideout?Video -6What city has the most snow fall?Geography +5Who is danny treasure?Music +9What is the national dish of greece?Geography +4What is the city with the least population?Geography +1Where is liverpool from?Geography *9Who is the prime minister in nineteen forty two?History ?9What should i do with used cooking oil?Food +9How many calories in a tube of pringles?Food +7How long does cauliflower cheese take to cook?Food +5What is gerry adams in the i. r. a.?History +7What is the average lifespan of a u. k. mail?Science -9 *2Who sings someone's knocking at the door?Music +5How many series of friends are there?Video +9How fast can a staffordshire bull terrier run?Science +9How do you cook a roast dinner?Food -8Who invented the custard cream?Food *5How many disabled people are there in the u. k.?Geography +4In this very small sample we can already surface many interesting if not astounding insights on who is using Alexa and how they are using the system. We can also create an “Expectation map” of what questioners are assuming is possible with Alexa. I could write many books on this general subject, but the Expectation Map, not used by any Voice First platform is very powerful. We can also see the obvious miscategorizations (and you cant change them when answering the question) of ontologies that will do nothing in helping Alexa find a useful answer.What appears to be random questions, I have discovered after analyzing million of questions since the 1990s there are “attractors” and “format types” that repeat endlessly. One format type example is the “How tall/heavy/old/etc is /famous person/?”. The categories are littered with these questions and can be answered using even the crudest AI /ML tools Amazon has. Not only do these questions require their now ontology, they also show a mindset and mentality of the questioner. Although “shaming” words are removed from the questions, they are implied and in some cases are passed through.Consider:How much does jean claude van damme weigh?VideoNot really a video ontology other then the fact he is an actor. This is a format type question in the “How tall/heavy/old/etc is /famous person/?” structure. The parse tree is simple. But lets examine the psychology and perhaps sociological aspects are interesting. Why do we see about 7% of sample questions in this category?Consider another format type question:How tall is john berry?VideoAgain not in the video ontology but we also have a potential common proper name spelling issue. Is it really “John Barry” of was it John Barrie an English actor who appeared in a number of television shows and films who became well known for playing the title character on the police series Sergeant Cork from 1963-68 and playing Detective Inspector Hudson on Z-Cars from 1967-68? Or did the questioner mean J.M. “James Matthew” Barrie, author of “Peter Pan” who like his character in his novels, was of a diminutive height. We don’t know because the questioner is long gone and all that remains is the question. However The Intelligence Amplifier had an In Band +1 assumption It was related to Peter Pan. We may never know as the questioner is long gone, all that remains is this question that to this day, Alex is stumped on.The format type questions all are In Band but many are Out Of Band or even Obtuse. Some reasons are based on subject, object, adverbial, verb and noun errors or miss readings by Alexa.Consider:How does an egg get fertilized?FoodThis of course should be categorized with the limited eight ontologies as Science yet it is Food. Indeed eggs are food, but what was the intent of the questioner. We can use format type here also in the “How does /thing/ /get/do/ /effect/”. Although this seems a more complex format type it really isn’t. We are really dealing with just eggs and the effect of fertilization, we assume food grade eggs but this may very well be a human reproduction question. How do we know? Context. Thus it is likely Alexa answered this as a food question and that was not satisfactory because it may have been in the ontology of food and produced a bizarre response to a human reproduction question.The Intelligence Amplifier, based on millions of questions and format typing found this to be a human reproduction question not a food question of edible eggs. Thus it seems clear why it became an Alexa Answer. Yet this miscategoization will prompt answerers to continue to present “wrong” answers because of the ontology.I have discovered in my research ~3000 format type questions that can cover about 80% of questions in my databases. Now understand I am just some guy in a garage but it is interesting how attractors form around certain subject matter. This of course is usually beyond linguistics and computer science professional domains and shows the blind spot in build Voice First systems using the “usual suspects” and lacking empirical praxis.Beyond format type questions there are other types that could lend itself to visual reinforcements.Consider:Where is denmark on the map?GeographyThis should not have been an Alexa Answers question for many reasons. Even if the questioner had no screen to show the map it can be said thusly: “Denmark, is above Germany and surrounded by the North Sea west of Sweden”. Did you need to see a map? Perhaps if you are not familiar with geography to any deep level. This question also show that a vast majority of questions are not “fact” but “feel” questions. For example we could have giving latitude and longitude data and digressed to highly localized geographical milestones, but this is to a high statical percentage not really what the questioner really wanted. They wanted a “feel” of where it was on the globe and subsequent questions could explore details if desired. But programmers and linguistics experts in group meeting would not agree to a “feel” for a question but will be biased to “facts”. And trying to find “facts” and not a “feel” for a question, even Wikipedia failed to find the fact needed. Is this a small issue? Not by the least the “feeL’ questions represent over 61% of questions I analyzed from Alexa Answers.Consider:What is the most thoroughly research nutritional product in the world?ScienceandHow many calories should you have for breakfast?FoodThese questions don’t have an objective fact they have a subjective insight. The questioners are not looking for anything really exact because it is likely they know there is no universal direct answer. The answers are situational to many elements including the health of the person asking and where they are located in the world. So a “fact” approach by machine, Wikipedia or a human answerer would yield a cascade of less than useful answers over time that will not find a means. But if a “feel” approach is used one universal answer or format can be achieved. One answer vs. thousands.As mentioned before there are many questions in my research data from Alexa Answers that simply do not need to be presented to answerers. Some out easily classified as Out Of Band and Obtuse and others are easily answered from Wikipedia and Bing.Consider:Is the universe still expanding?ScienceAndWhen did bts debut?HistoryAndWhere does mars come from?ScienceAndAre there different galaxies?ScienceAll of these questions waste the time of Alexa Answerers and have simple answers, yes even the BTS questions. So why are they here to be answered? We can only speculate but this along with many other observations I can conclude some serious errors of how Amazon is approaching how they extract intents and meanings.There is a cross section of psychological states presented by the flow of questions found at Alexa Answers.Consider:How do i convert baking soda to baking powder?FoodWhat is the zip code for wenham massachusetts?GeographyDo deers have whiskers?ScienceWhat year was the waco fire?HistoryHow many people live in wild?GeographyHow many ribs does a t. rex have?ScienceIs the tower of babel still standing?GeographyHow much does the heaviest cat weigh?ScienceWhere was the beatles last performance?MusicWhat are the properties of oobleck?ScienceWho is johnny carson's sidekick?VideoWhat year did microwave ovens come out?VideoWhen did naruto first air?VideoWe can conclude that some questions seem to be trivia but on deeper analysis they are not. Some are historical or scientific “facts” but without the context of a conversation one could answer these questions in a manner that would not really reach the essence of the question. Clearly there is no reasons for zip code questions to appear at Alexa Answers. If this was a failure of the Alexa platform it is glaring. I have seen dozens of zip code questions.We can also conclude the location of the Alexa device by virtue of the types of questions rendered. We can also get a feel for when these questions are being asked over the course of the year. It would be helpful for Amazon to show a date and time.Consider:How long will it take to cook a five kilogram turkey?FoodAndWhat temperature do you cook a twenty pound turkey at?FoodAndHow long does it take to cook a twenty eight pound stuffed turkey?FoodAndHow long to cook a sixteen pound stuffed turkey?FoodIt does not take much to conclude these questions are being generated to a high statical percentage around holiday seasons. Likely Thanksgiving and Christmas holidays in the US. You may have noticed a format question here and you are correct. This is a “How long do I cook /Food/ that weighs /weight/?” with variations there are 100s of these questions. There will be hundreds of Alexa Answerers producing specific answers in rote to the endless weight combinations. It is really quite shocking these types of question, weighed to almost the largest percentage has not been automated. It is elementary.The type and range of questions may seem random to even expert observers that do not study this deeply to any level. Yet there is a rather clear psychology behind many questions and attractor patterns are easy to see with even limited data.Consider:What is the most played video game in america?VideoAndWhat are french hens?ScienceAndWhich state has the least amount of natural disasters?GeographyAndWhat color is dove cameron's eyes?VideoAndDo you have a recipe for pumpkin seeds?FoodAndDoes pumpkin pie get refrigerated?FoodAndDoes sweet potato pie need to be refrigerated?FoodAgain, we see holiday cooking. More exactly some post holiday cooking. We also see questions that relate to fears (natural disasters) and human interest (eye color). There is much to be said about post meal food preservation, in particular pies (were they homemade or preserved unrefrigerated store bought pies). What is the “pie psychology?” here there are obvious business cases here but there is also mindset aspects. We also see mindset aspect with the utilization of pumpkin seeds, likely related to making a pumpkin pie or Halloween carving, again dates and times of the question create at least some limited context.The psychology of the questioner can be extracted by the Affect protools of The Intelligence Amplifier and from this some correlating demographic and age cohort data can be extracted. From a sociological and anthropological basis I have also found a rich treasure trove of data. We know the general psychological state of the Alexa user, and how this will play out over time in sociological and anthropological studies. Part off my research creates a statistical word use study that aids in understanding the sentiments of the users. From a fundamental level this data can be used to make Alexa work better. Indeed I have used this data to make The Intelligence Amplifier work better.We can also find opportunities for new businesses and in the case of this report over 27 points of Clayton Christensen disruption either by Amazon if they discover it or by startups or legacy companies if they discover it. I can not over state how many opportunities have been surfaced just by this small study of Alexa Answers. Just by knowing what people curious about and how they ask these questions is an astounding opportunity.ConclusionsIt may be easy to read this presentation as an attack in some way towards Amazon, the Alexa team or the AI community a a whole. Read this clearly: it is not. In fact one reason I requested to release some of this report to the public is to in some way hope to help them. Many ask why I am not working in these companies and could do this privately. Well the short of it is: I really don’t know other then the fact I may be “un hirable” by the current hiring practices at play in technology companies. Even though I could pass the “prove you can code before you can come aboard” hazing tests at play to this day, I am still admittedly a Round Peg to their Square Hole.It can be argued that some of this information is known to the Voice First companies, however I can say with certainty via private conversations most of the information and solution presented here is not widely known for if it were it would not have fallen through to Alexa Answers. It is also very clear this is not just an Amazon problem, Google, Apple and others, I know from other studies have the exact same problem to a greater or lesser degree along with other problems.The Voice First revolution is relatively new. Answering the “long tail” [10] questions and finding the correct short form to long form answer is new for many of the people building these systems. Without empirical praxis and using purely and engineering approach solving these issues. What do you do when you don’t know the answer to a question? You find the answer. The next generations of Voice First systems will find better answers.The Case Against General Artificial Intelligence And The log2(n) - n ParadoxOne of the great debates raging in the tech community is that Voice First systems like Alexa, Siri, Cortana, Google and others are too “dumb”, “they can never answer every question”. The truth is, of course they are. These generation one systems fail outside very constrained domains. Yet using the same criteria to humans, we all look pretty “dumb”. The invention of writing, the printing press, the book, the floppy disk and the Internet allow any properly equipped human to answer any question, or get a fairly good “feeling” of the potential answers.It turns out humans think in a “fuzzy” way. Our answers, as logical as they may seem sometime may have foundations in logic but they are fuzzy in the way they are translated to humans. Most humans chose not to speak in segments of facts connected together and if we do, we suffer a life of loneliness. Humans use analogy and reference to express things. Many researcher and observers assume this is exformation (information to be discarded). However the things we use to present concepts, ideas, even commands have a multiplex quality to how it was said.Thus when we are asked a question it is quite natural for us to simultaneously decode the multiplex layers of context. Many times we will ask additional questions to full understand what was said or the command. However overtime humans learn by doing and tend not to ask rebound questions, we apply prolix, we speak in shortened sentences and we take the sentences as a meta command or meta idea.For computers to solve the what I call the log2(n) - n paradox (or the Evan’s paradox) they need to deal with the Fuzziness of humans and turns out that it is not the “insolvable” problem that even learned experts suggest. The Turing Test was first proposed in 1950 by Alan Turing in the paper “Computing machinery and intelligence”. Turing is commonly acknowledged as the father of artificial intelligence and computer science and later developed the Imitation Game as a substitute for the question “Can machines think?”. The Turing test is interesting but is not the baseline of how future Voice First systems will deal with the log2(n) - n questions and log2(n) - n answers almost seemingly impossible task. Moreover, Turing’s intentions were never to use his test as a way to measure the intelligence of AI programs but rather to provide a coherent example to help arguments regarding the philosophy of artificial intelligence.The idea that any AI system has to anticipate every question and produce a ready-made answer is not only unachievable it is a complete misunderstanding too the way humans work. No system will be omniscient, omnipotent and omnipresent. No human, even with the assistance of the internet can address log2(n) - n questions and log2(n) - n answers. Thus to pose a premise that not living or a mechanical system could achieve as an argument against the utility of Voice First systems is an argument under a false premise.Thus Alexa Answers does not seem to have the successful game mechanics that has made Quora successful. This is vitally important for this system to work on a long term basis and not face the Yahoo or Google fate. Additionally we can conclude even if Alexa Answers is successful it will not nearly address the systemic problem at play here either use humans to answer questions or go for a AGI Turing test approach. The reality is it is not a binary choice. Using simple but very powerful protocols that you and I use every day would give the next generation of Voice First devices the ability to answer any question.Sites like Quora and systems to distill long form answers to the needs of the questioner in real-time will be of a tremendous step forward for Amazon. We will always need Q & A systems that extract and utilize first person knowledge that inherently is more fuzzy feel of information and insight than Wikipedia-like fact. This is how all cultures work through history. Indeed this is even how science works. We first arrive at the feel of a subject and then drill down to facts after if this is desired. Humans get mired down with data and not directionals of feel. Some may argue this is a fundamental flaw in humans and may use it as an inditement of our current condition today. This is a mis attribution. What humans need is a feel for the directional to help find the overview and then generate the supporting facts.We do not see the facts of the 2 x 4s and sheet rock of the outside of the house, we see the overall structure of the house and can draw many conclusions about what functions it serves and perhaps the type of rooms it contains, because the direction feel of the subject has been determined, it is a house. Today we have the builders telling us how the house was made and what it is made of. This is natural for people that have to form logical program functions in code. But as this though pattern matriculates up to the product, we actually wind up with a system that has far less utility then it could.Specimen showing Voice First is the fastest adopted technology in history.Voice First is the fastest adopted technology in history. No technology has even come close, not the smartphone or the tablet. Amazon has a majority market share with Alexa. This is deserved and earned. Yet we have not seen anything yet, this is the very early days of the Voice First revolution and even with some of the issues I presented here on Alexa Answers persist.Alexa will continue to do outstanding. Amazon is one of the few companies that get what this technology represents and has dedicated over 20,000 people to make it better. No matter what, we can expect Voice First to get much better. We are at the precipice of a new way to communicate with computers and an new way to arrive at data, information, knowledge, insight, wisdom and understanding. In the past we had to sift and sort through data and information in hopes of some knowledge. The voice First revolution with the correct protocols will bring about insights and hopefully more wisdom and understanding. We are awash in data, we need more wisdom and understanding.[1] Alexa Answers[2] There is A Revolution Ahead and It Has A Voice[3] Brian Roemmele[4] Brian Roemmele's answer to Is Amazon Echo (and/or Siri and other voice assistants) actually useful, or is it just a novelty? Are usage and retention of these products growing?[5] Brian Roemmele's answer to Is Quora important to Siri?[6] Brian Roemmele's answer to Is Siri important to Quora?[7] Amazon Mechanical Turk[8] Likert scale - Wikipedia[9] http://VoiceFirst.ExpertMore details on the Alexa Answers Product.What is Alexa Answers?Alexa Answers is a community where customers can answer questions for Alexa. It contains questions in categories such as Science, History, Literature, and Music which Alexa would like your help in answering.Where do you get questions from?The questions on Alexa Answers are facts Alexa customers want to know. If enough customers ask Alexa a question she cannot currently answer, that question may be published on Alexa Answers.How can I add answers to Alexa Answers?Just browse the categories, select a question you would like to answer, type your answer and click submit.How is my Amazon profile displayed and can I contribute anonymously?You have the option to contribute anonymously or display your Amazon profile information to other users on Alexa Answers. If choose to display your profile information, your profile name and profile image will appear on your answers and throughout the site. It will not be shared when Alexa delivers the answer to an Alexa Customer. If you choose to hide your information, you will appear as “Anonymous” to other users. You can manage your Amazon profile visibility in Settings.What makes a good answer for Alexa Answers?Good Alexa answers respond to the question briefly, directly, and accurately, in a contributor’s own words. They do not contain any content that is obscene, threatening, defamatory, invasive of privacy, or infringing of intellectual property rights (including publicity rights).What answers are not accepted on Alexa Answers?In order to generate helpful responses for Alexa to use when she is asked questions in the future, answers must be kept to under 300 characters. Answers may also be automatically rejected if they contain any of the types of objectionable content listed above. For additional information about what content is and is not accepted on Alexa Answers and other Amazon sites, please see Online Shopping for Electronics, Apparel, Computers, Books, DVDs & more’s Conditions of Use.What happens after I submit an answer?If your answer is accepted, it may be made available on Alexa next time a customer asks the question you answered. If more than one contributor answers a specific question, Alexa may rotate between answers until she gains enough feedback to determine which answer is the most useful. You can tell that your answer is available for Alexa to use if the blue “LIVE” icon appears below your answer.How do I report an offensive or bad answer?You can flag an answer on Alexa Answers to report them. Answers can be flagged if they are inappropriate (subjective, advice, vulgar, insulting, or offensive), incomprehensible (it doesn’t make sense when read out loud), or incorrect (not factually correct or relevant). Once flagged, the answer will be hidden from your feed and reviewed.What does it mean if my answer is flagged?Your answer was reported by members of the Alexa Answer community and/or Alexa Customers. Answers can be flagged if they are inappropriate (subjective, advice, vulgar, insulting, or offensive), incomprehensible (it doesn’t make sense when read out loud), incorrect (not factually correct or relevant) or not helpful (it's received too many downvotes from Alexa customers). Flagged answers are not visible on the Alexa Answers site and not shared with Alexa Customers. You can rewrite and resubmit your answer to address the reason for flagging. If you think your answer was flagged erroneously and would like to dispute it or get more clarity, you can contact us at email and we will review your answer and provide a response, if appropriate.What do the thumbs-up and thumbs-down numbers below my answers mean?When Alexa uses your answer, she may also elicit feedback by asking 'Did that answer your question?' The number of likes reflects the number of times customers said YES to this question. Similarly, the number of dislikes reflects the number of times customers said NO. (As noted above, if enough customers say NO your answer will become blocked and will no longer be used by Alexa).How are the leaderboards calculated?Leaderboards show the top ten weekly and monthly contributors on Alexa Answers. The leaderboard ranks contributors based on points earned on answers submitted within relevant category and time period. Monthly leaderboards reset on the 1st day of each calendar month. Weekly leaderboards reset every Monday.What do the point values mean and how are they calculated?Each answer is given a point score based on the number of times Alexa shares the answer and the quality of the answer. Answer quality is determined by Alexa customer feedback. When an Alexa customer hears an answer they can tell Alexa if the answer was helpful or not. The more positive upvotes an answer receives the more points it earns.I want to correct my answer, how can I edit it?You can click the three dot button to reveal the edit and remove actions. The sooner you do this after you submit the answer, the less likely you will lose any feedback your answer gathered.What if I submit an answer by mistake? How can I delete my answers?You can click the three dot button to reveal the edit and remove actions. Remove means your answer will be no longer be used by Alexa and all the statistics associated with the answer will also be deleted.What does Alexa Answers do if there are multiple answers contributed by the community for the same question?If more than one response to the same question is provided on Alexa Answers, Alexa will rotate between each of the answers until she has enough information to know which answer is the most useful. You can help Alexa choose the most helpful response by providing feedback. Answers with most positive feedback will be used more frequently.What is a HOT question?A HOT question is a popular question on Alexa. It is also more likely to get asked again by other Alexa customers.What are star ratings?You can help Alexa Answers be great answers, by rating answers submitted by other contributors. A 5-star answer is a high quality answer. Alexa can use contributor ratings, along with feedback from Alexa customers, to determine when and how often each answer is used.What should I do if I believe someone has used my intellectual property to respond to a question that appears on the Community Answers page?You can report intellectual property infringement by sending an email with the following information: (1) A physical or electronic signature of the person authorized to act on behalf of the owner of the copyright interest; (2) A description of the copyrighted work that you claim has been infringed upon; (3) A description of where the material that you claim is infringing is located on the site (for example, a screenshot or copy/paste of the question and answer you claim is infringing); (4) Your address, telephone number, and e-mail address; (5) A statement by you that you have a good-faith belief that the disputed use is not authorized by the copyright owner, its agent, or the law; and (6) A statement by you, made under penalty of perjury, that the above information in your notice is accurate and that you are the copyright owner or authorized to act on the copyright owner's behalf.What happens when I follow a question?When you follow a question, you opt into receiving Alexa device notifications on that question’s answer activity. Click the star icon to follow a question. After following a question, Alexa will notify you through your Alexa device if another contributor submits an answer within 7 days.

What is the best way to learn and write an AI Chatbot? What are the latest research papers that I should read?

First, understand the goal of the AI Chatbot you’re building. Is it about achieving a high resolution rate 80%+ and delight your users or is it just about launching a bot that provides minimal resolution say 20%? Learn about various approaches and types of chatbots you can build to achieve that goal. Then, determine technology and resources you’ll need. Finally, implement: procure data, design, implement, and experiment for high resolution rates. I’ve added few other critical considerations: integrating with CRMs, determining most effective channels/modalities, and considering humans as back-ups for errors and escalation.Two types of chatbots: information seeking and transactionalChatbots accomplish two types of tasks: seek information or complete a transaction. Information seeking bots are relatively easier to build (e.g. accomplishing ‘what’s my account balance?’) than transactional (e.g. accomplishing ‘please change my seat on the second leg of my tomorrow’s flight to an aisle seat.’ or ‘set up automatic payments for my auto insurance but not my home insurance and split monthly payments across a debit and a credit card’). Key considerations to building either type of chatbot:Interaction: Natural Language or Directed DialogDesign (conversation, visual, and interaction)CRM integrationChannels and modalitiesEscalation to humansChatbot interaction: Natural Language/Conversational or Directed DialogFor either chatbot, natural language can be applied to both input (what’s spoken or typed by the user) and to output (what’s spoken or shown visually by the chatbot). Stefan’s matrix explains this clearly and either machine learning based Natural Language can be applied with satisfactory performance or rule based directed dialog can be implemented with sub-par performance (I’ll get to the reason of poor performance in a bit). Pros of machine learning: delivers higher performance or resolution rates. Cons: requires lots of data and specific skill set (to create, models) and/or tools (to create/tune models).Directed dialog or rule based approach (no machine learning or AI required) provides limited options to the user for both input and output e.g. “Select one of the following - 1 for appointments, 2 for doctors directory, 3 for insurance details, 4 for other reasons ”. These options can be visually in a design paradigm pioneered by Facebook Messenger[1]. In a directed dialog interaction, the driver of a conversation is a chatbot and not the user resulting in an unnatural, not so conversational and often constraining and frustrating experience as most of us have experienced with traditional phone systems. Most current web and mobile chatbots are directed dialog style. Reasons for low performance for directed dialog or rule based approach:Discovery challenge: complex business logic results in large decision trees and users have a hard time discovering their specific question, which happens to be a tiny leaf node lost in a complex decision tree. Often users pick a wrong reason just to get to the next step.Too restrictive: users don’t like getting constrained and look for other means to resolve their problems. This is particularly pronounced as users don’t speak the brand jargon.Success (in terms of transaction completion or resolution) is not satisfactory with either approach (yes, even with Natural Language!) with a pure technology approach as was evident with Facebook Messenger chatbot, which did not achieve more than 30% automation even when AI and Natural Language was applied. Key reasons for poor performance of Natural Language approach:Doesn’t take care of all the non-happy-paths that represent reality of conversationsUsers don’t always always say what they mean when posed with “How may I help you”. Partly because users don’t speak the brand language of a specific chatbot/company. For instance, chatbots expect “baggage handling exception” instead of “problem with my check-in suitcase” or “balance transfer” instead of “sending cash from one account to another”. To address this ambiguity, either disambiguation, which is to clarify what the user meant. Alternatively, predictive technologies can be applied to determine the real intent.objective changes - humans love to change topics in most conversations e.g. the following journey is not uncommon for credit card users: start with payment status, jump to available credit, then pay off the third credit card and why not check last week’s transactions in-between.Conversation interaction design: manual approach and pure AIConversation interaction design takes care of the above shortcoming of Natural Language. It focuses onDesign flows for non-happy-paths. Example, I’d like to make a payment and split it across a gift debit card and my credit card. A few steps later actually, I change my mind and would like to split it across two debit cards. This change of mind is particularly where most chat bots fail.Objective changes. Example: I’d like to opt-out of paper mail delivery before I make that split payment)Verbiage/modality of the response. More often directed dialog response (such as quick replies, carousels, radio buttons) is better for output but not for input. Users like guidance but not constraints.In reality, human conversations encounter non-happy-paths and objective changes very frequently (evidence: observed in human agent conversations over chat and phone and many 1:1 settings). Conversation interaction design helps you elegantly handle these expected non-happy-paths. It gets complex as you add speech/audio to the mix.Downside of this manual conversation interaction design is that it is time consuming, requires specific skill set and is manual. When complemented with Natural Language this approach yields very high performance and task completion rates. It also requires specific skillsets: interaction design, content design, and Natural Language skills. If your AI chatbots represent large set of intents this is a sure shot approach to high performance.Pure AI approachGenerative AI for output and applying machine learning to the entire conversation replaces interaction flow design. However, pure AI approach requires large set of data of real human conversations with both input and outputs for both happy and non-happy-paths. Procuring enough representative corpus of such data is a practical challenge if you don’t already have human conversations taking place. Another challenge is entity extraction for inputs and generation with new entities after interacting with dynamic CRMs/user databases.CRM integrationDon’t forget to plan integration with CRM (business back-ends and user databases) that determine specific actions and read/write user or journey specific information. Simple weather lookup bot doesn’t care about complex CRM integration but if a bot is required to upgrade your mobile phone data plan , access to your mobile phone provider’s database is required for query, create, update, and delete operations. Very few large enterprises have programmatic RESTful access and this can be a time consuming task when integrating with proprietary CRMs.Channels and modalitiesDetermine which channels and modalities you want to associate with your bots. This is driven by the bot users’ preferences, behaviors, and specific vertical/domain the bot is serving. For instance, in an automotive scenario you may want to use speech recognition based interaction (either in-app or via a phone). For millennials, you might want to use Facebook Messenger as a channel. For premium products, Apple Business Chat might make sense given Apple products are more used by higher income individuals.Humans as back-up or for correct escalationsHumans will always be required for two reasons:(1) right reason: business policies might mandate human intervention e.g. refund of an expensive flight ticket after an incident(2) wrong reason: bot doesn’t perform per designEnsure you have a plan for both (1) and (2).Finally, you can experiment with various readily available bot services such as Microsoft Cognitive Services, IBM VWA, Wit or Amazon Lex to create a chatbot. Neither are enterprise grade. For enterprise grade chatbot frameworks refer to the latest top 10 report from Forrester. Summary of the above considerations:Disclaimer: I have built all types of chatbots mentioned above with a ~90% success rate and delight factor in my previous role at [24]7 Inc., , leading product management for enterprise AI self-service experiences.Footnotes[1] http://Quick Replies - Messenger Platform - Documentation - Facebook for Developers (https://developers.facebook.com/docs/messenger-platform/send-api-reference/quick-replies

Comments from Our Customers

Truly a great site for necessary forms. Very easy to use. Customer Service was wonderful to deal with and very knowledgeable and helpful. I would highly recommend. Thank you.

Justin Miller