cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3...

224

Transcript of cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3...

Page 1: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ����������� ������������� � ������������� ���

! "$#&%(')%('*#&%+"-,/.1032�,/4653'*78,

9

:<;>=@?/A3B�CD?/A3BEAGFEHI HKJ/LMLNF<O�?/A1HPFQA1JSRTAU AMVWLMLNXZY6A1J/[\A1]

^ LM_`AGBEFQabLcJSFedTfgO�dTab_`h/FQLMBiY>jNHkLcJ`jlL$A1J`m�ngJo[THpJoLMLMBqHKJ/[r J`moHkA1J r Jo=sFEHPFEh>FQLtdTfvuwLcjq?`J/dT]pd\[1Ryx$A1J/_`hoB

z|{~}���������}���{����Q}�{����E�\���K����������G�|�E���Q�N�����)�G  �q���E¡¢� �E�¤£M¥G¦�¥

�v�E�¤�l§�����£���¨M�q  �)�N����§©�|��ªc£«�Q¬T­@­W§)�G�N®1¯&����¥ ¬G�Q§¤�

°±��­@ l§)��¡s­s²´³(�E¦�¦Sµ«¶/·* Gª ���¸(­W¹»º|­@¦��G�

¼M½¾�¿«À�ÁpÂ*Ã�Ä ½ ÁPÅ�Æ Ç�ÈÉÈWÊ�ËqÌ~¢͢ÄÎǤÏqÐ�Ê�ÀcÑ¢À�Ä Ò�Ç´Ã�Á1Ó¤Ô�Á1Ê�Â¢È Õ*Ï«ÖGÊ6¢Ê�à ×/Ç�Ø�Á ½ Ê�Ñ¢ÄÉÁkÔKÏ

Page 2: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�� �����������

�T����§ µ«¶� >���«¥c��­@� �M���°±��­@¶��q¡ ­ �� ¡¤�M Gµ@¹ ¦�­@ª��«­@��­@ l§)� �M������ ·* l§)�¢µcª ¥G¡�§¤��µ« <§)µ�¸��T° �

��������� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���������� 12#,3547698;:<35=;>�40?@=;=;>���(A:B�$�+#,�)CD�/�.�/�.�/�0�/�/�.�/�.�/�.� ��������FE ?G(IH;�+4AJ�4A3K4A� �$CL:<�M%ONP!$�+4RQTS@��CU�"#,!"VO�/�.�/�0�/�/�.�/�.�/�.� E������� W XG=Y4R��Z[!$#�\)>+4A35C]�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^

���FE`_]:<ab#�!@c0#,:�>d�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ef ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,�k �T�q ��«¥ �)��­�¨M§���¥G¡�§¤¥c��­ �q  ªl�S�E ��«¥G�;��­ �  G�E¦�£nms­W� �&o

E&������� �"!$#&%&')(*�$�+#,�O�"#Dpq:��;i�'):�i�4/1 �"!$')(r�"';!$4 �.�/�.�/�0�/�/�.�/�.�/�.� �sWE&�FE XGJ�4A!"J2��4Rtu#�Qvp�:<�;i,'):<i,40?@�):<>�V2wR4A!x�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E�y

E&�FE&��� _�#,!"=)H;#�>�#�i,��(A:<>z?h�):�>+V2wR4A!{�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E,EE&�FE&�FE pq#2(A:<>�|}#�!I%Oc0!$#�')=M4A!7~�p,|�c/���.�/�.�/�0�/�/�.�/�.�/�.� E<�E&�FE&� W ��#,!"4/Z9:<!IC"4R!��.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E,�

E&� W�gL4s�,')�+!$4R354R� �ICL#<Q[��#�35=;'&�I:B�"��#��M:<>qc0!I:<353D:<!IC��0�/�/�.�/�.�/�.� E,�E&� W;��� ��#,3K=)'&�$:<�"��#��):�>n?@C"=M4s(*�-�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E�^E&� W;�FE 12V&CU�"4A35C@?@C"=M4s(*�5�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E�^E&� W;� W p�:<!$i�4/12V&Cb�$4R3�?GCU=Y4A(r�0�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E ef ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E��698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E��

o�� µ���ª �©�E Gª�¯&�G­W��� �  G�E¦�£nm ­W� oYoW;������� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� W,WW;�FE�|lH2V�_�#,!"=)H;#�>�#�i,��(A:<>z?h�):�>+V&C"��C��/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� W)�W;� W�_�#,!"=;H)#�>�#�i���(R:�>nc04R�;4A!$:<�"��#����GCU���;i�Z9:�!$:,%&�+i,3DC��0�/�/�.�/�.�/�.� W,^W;� � _�#,!"=;H)#�>�#�i���(R:�>�?h�):�>+V&C"��CL�GCU���;iDZ9:<!I:�%&��i�3DC��.�/�0�/�/�.�/�.�/�.� W,�W;�F��12=Y4R4s%&�+�)i��h=�_�#�!$=;H;#,>+#,i���(R:�>z?@�):<>�V&CU��C�\2VO��#�35=;��>�:B�"��#��z���/�.� �2EW;� ^�_�#,!"=;H)#�>�#�i���(R:�>�?h�):�>+V2wR4A!��O12#�354/?@%;%;���$�+#,�):<>n�bC$C"';4AC*���/�.�/�.� �,�f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �&e

698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �&e

Page 3: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���� �Tµc¡ �E¦ � µ���ª��|��µ«¥c¬3�� T� ����)������� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � �

�)�FE��94R!$\]c0!"#,';=)C��/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ��y�)�FE&��� �.!$�+V :xgh';=): ��H):�!U�ICx�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ��y

�)� W�h#,';�]c0!"#,';=)C �/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ��W�)� � 1 �$!$:<�"4Ri,VDQ #�!@c0!I:<353D:<!�G4RJ,4R>�#�=;354R� � �.�/�.�/�0�/�/�.�/�.�/�.� ��W�)�F��124A35:�� �"��(RCL���]1 �$:�i�4AC �/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,��)� ^ 12#,3K4xXG=Y4R��Z !"#,\;>+4A3DC��/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ��^�)� e���#��M(r>�')CU��#��MCd�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���

698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���� °o�q  ��  ���E  �|���E�����Q� ����&������� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���

�&�FE���H;4 124A3D:<� �"��(/_�#&%&4R>-�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^,y�&� W f !$4R4/|}#�!I%�XG!$%&4A!L:<�)%��@��\;H):�� �"� �.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^���&� � Z9:<�)�+�;��:<����H;4A#�!$V �/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^2e

�&� �)��� �/:�!$:�� :KgL4A>�:<�"��#��)C-�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^2e�&�F�`?@(r�"��J�47Z9:,C"C"�+J,4h�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^,��&� ^ ��#�� �$!"#,> �/�/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� e<y

�&� ^;��� �/:�!$:�� : �"#��G�+\;HM:�� �"�q_-:<=;=;���;i�.�/�.�/�0�/�/�.�/�.�/�.� e<y�&� ^;�FE �/:�!$:�� :512H):�!"���;i �/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� e&�

�&� e`12';353D:<!$V �/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� e,ef ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,y698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,y

� °o�q  ��  ���E �°o�Q���¤­W� � �^;������� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � �^;�FE ��#�!$4/Z9:<!ICU4A!d�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �2e

^;�FE&��� ��#,�)Cb�$!$:��+� �IC �.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,�^;� W ��#��MCb�$!$:��+� �hZ9:<!ICU4A!P�GCU���;i5��� �"4Ai�4R!hZ !"#,i�!I:<3535�+�)iK�/�/�.�/�.�/�.� �)�^;� � ��#��MCb�$!$:��+� �hZ9:<!ICU4A!P�GCU���;iD_]:<�$(IH;���;iD:<�)% ?GC"C"�+i,�;354R� � �/�.�/�.� �,W^;� �)��� gL4s%&')(r�"��#��O�"#DNP�+=M:<!"�"�+�"4 c0!I:<=;H _]:B�I(IH;���;i��/�.�/�.�/�.� �,W

^;� �)�FE gL4s%&')(r�"��#��O�"#D?@C$C"�+i,�;354R� �@Z[!$#�\;>�4R3 �/�0�/�/�.�/�.�/�.� �,^^;�F�`Z[!$4rQ 4A!"4A�)(r4sCP#BJ�4R!LZ9:�!$C"4AC �/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,^^;� ^�pq:��&CUH):�����HM:<!"�$CPQ #�!@1&4R�)C"4�@��C":�3 \;��i�'M:B�"��#�� �/�0�/�/�.�/�.�/�.� �,^^;� e`12';353D:<!$V �/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,�f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,�

698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,�

Page 4: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���+������E¡¢�G�� G­�¯S�¢�q  �¤¦��Q§¤��µ«  ���q�e2��� 12';!$J�4AV �.�/�/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay)�

e2������� ��� �"!$#&%&')(r�"��#�� �/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay)�e2�����FE Z !"#,\;>+4A3DC�#�Qv_-:�(IH;���;4��q!I:<�MCU>�:B�$�+#,� �.�/�0�/�/�.�/�.�/�.� �Ay)�e2����� W �bCh_ �dZv#,C$C"�+\;>�4����0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay,We2����� � NP!$�+4RQTSh��CU�"#�!$V �/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay,We2�����F� Zv# C"C"�+\)>+4.?h=;=)!"# :�(IH;4sC��.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay��e2����� ^ ��';!$!$4R� �@1 �$:<�"')C{�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay �

e2�FE`?h�2')C$:<!I:��B:x#�!hp�:<�;i,'):<i,40?G(R(r4sC"C"#�! �/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay,^e2�FE&��� N�:�( �2i,!"#,';�)% �.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay2ee2�FE&�FE ��'&�"�"���;i5�"H)4 c0#�!I%&��:����.�)#<�7�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay2ee2�FE&� W ��H;47Z !"#,\;>�4R3 �/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay,�e2�FE&� � 1 �$!"'M(*�"')!"4/#�QT?h�2')C$:<!I:��B:512V&Cb�$4R3��/�.�/�0�/�/�.�/�.�/�.� �Ay,�e2�FE&�F� �GCU4A!L���,�$4R!"Q�:�(R4D�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���sye2�FE&� ^ pq�+�;i,';��Cb�$��(/?@!"4s:��/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���,�e2�FE&� e c0��J2�+�;iD')=O?@i�!$4R4R354A�,�L����?h�2')C$:<!I:��B:5XG';�"=;'&� �/�.�/�.� ��� Ee2�FE&� � p�:<�;i,'):<i,40NP!$��%&i,4AC��/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���sW

e2� W 12';353D:<!$V �/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ��� �f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���Be� µ���¬G�Q�����)µ« �¹ ��§¤�t¨Mµ«��­ � ­@�)§)­W��  � µ«�D¬3¥c§¤�Q§)��µ� G�E¦ �|���E�e���Q���

�`�T­ �M��¡ �E¦� c¥G G¡�§)��µ� G�E¦ �|���E�����E� �Y� ��;������� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���s��;������� ?G(*�"��J�4� Z9:,C"C"��J�4G:��)%�G:<�"��J�4 ��#��MCb�$!"')(r�"��#��)C��/�.�/�.�/�.� �sE�y

�;�����FE |lH�� 35#BJ�4A3K4A� ������G';4ACU�"��#��MC �/�.�/�.�/�0�/�/�.�/�.�/�.� �sE;��;�FE XGJ�4A!"J2��4Rtu#�Qvp f c �/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �sE�W�;� W�p f c f #�!$3D:<>���C"3 �.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �sE�W�;� ��|}4R>�>�� Q #�!$354A%&�;4sC"C@��#,�)%&�+�"��#��)C��.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �sE,��;�F�`S@:��)%&>��+�)iD|lH�� 35#BJ,4R354R� �L�+��G';4sCb�$�+#,�)C��/�.�/�0�/�/�.�/�.�/�.� �sE�^�;� ^ ��#�35=;';�$:B�$�+#,�):<>n?GCU=Y4A(r�$C �0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �sE e

�;� ^;��� f 4A:B�$';!$4ACL:<�M% f 4A:<�"';!$471 �"!$')(*�$';!$4AC �.�/�0�/�/�.�/�.�/�.� �sE e�;� ^;�FE �@�;�� Y(R:B�$�+#,���.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW,y�;� ^;� W X@�$H;4R!G��#,�)Cb�$!$:��+� �IC �/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW)�

�;� e���#��M(r>�')CU��#��MCd�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW Ef ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW E698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW E

Page 5: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��J� � � �E Gªi·* GªG���E l�S�E ��«¥G�;��­@� �&o���;���j� f c�:<�M%����M%&��:���>�:<�)i�'):�i�4AC��.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW �

�;�FE f ')�)(*�$�+#,�):<>�1&=M4s(r� M(R:<�"��#�� �0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW2ef ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �AW,���� ¯S�¢­@­ � ª � µ«�� G�� T� �|���E�e���Q� �&o �

�Ay)�+��pn4R8&��(A:<>��+wA4A% c0!$:�3K3D:�!$C�:<�M%Opq#&(R:<>��+�bV �/�.�/�.�/�0�/�/�.�/�.�/�.� �AW,��Ay)� E pn4R8&��(A:<>��+wA4A%��q!$4R4712';\MCb�$���$'&�"��#��-c0!I:<353D:<! �.�/�0�/�/�.�/�.�/�.� �R� y�Ay)� W pn4R8&��(A:<>��+wA4A%��q!$4R4/?@%Bab#����;�+�)i c0!$:�3K3D:�! �.�/�.�/�0�/�/�.�/�.�/�.� �R�2��Ay)� � f 4s:B�$';!"4 12�"!$')(*�$';!"4sC �.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s�,E�Ay)� � 12#,3K47_-:B�"H)4R3D:B�$��(A:<>n?@C"=Y4A(*�IC �.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s��^f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s���

698&4A!$(R��C"4AC��/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s����Y� � µ���¬G�Q���� ���¯ � ��¹ ��§)�<° � � �Yo

���,�+�}��� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,W���,� E 12��35�+>�:<!$���$�+4sChNP4r�btP4R4A���T?hc :��)% Z�c �/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,W���,� W G���z4R!$4R�)(R4ACL\Y4r�btP4R4A� ��?hc :<�)% Z�c �/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,^

���,� W)�+� XG=&�$�+#,�):<>n?@!"i,';354R� �$C��.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,^���,� W)� E�124A� �"4R� �$��:�>n#�! �94R!$\):�>n?h!$i�';354R� �ICD�/�.�/�0�/�/�.�/�.�/�.� �A^,^���,� W)� W 12#,354/��3K=Y#�!"�$:�� �LZ H;4R�)#�354R�):j�.�/�.�/�0�/�/�.�/�.�/�.� �A^2e

���,� � G��C$(r')C$C"�+#,� �/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,�f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,��;k � µ2��­W�� G��­@ l§w�E Gª��w�� Gª �� �� � � ��sE;�+�}��� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^,�

�sE;� E ��H;4 c.N _�#&%&';>�4AC �/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e&��sE;� E;�+��� � \):�!��"H;4A#�!$V��/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e�E�sE;� E;� E ��H;4R�$: ��H;4A#�!$V��/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e�E�sE;� E;� W c0#BJ,4R!$�;354R� �7�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e<W�sE;� E;� �{�P:,CU4���H;4A#�!$V��/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � eB��sE;� E;� � NP#�')�)%&���;iK�"H;4A#�!$V �0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � eB��sE;� E;� ^�6 3K=;�bVO�P:B�$4Ri�#,!"V�Z !"���)(R�+=;>�4D~�6��PZ��G�.�/�0�/�/�.�/�.�/�.� � eB��sE;� E;�Fe�NP���)%&���;i5�"H;4A#�!$V��/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � eB��sE;� E;� � ��#,�)Cb�$!$:��+� �IC�#,� 3K#BJ,4R354R� � �/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e��

�sE;� W Sh#Bt �P:<��c.NuS@4R>�=��+� Z9:<!ICU���;i � �.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e<^�sE;� �u��#��M(r>�')CU��#�� �.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e<�f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e<�

Page 6: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

J�&o � µ���¬G�Q���� �� � � ¹©��§)��° � � � ��AW)�+�}��� �"!$#&%&')(*�$�+#,�-�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e<�

�AW)� E 12';353D:<!$V �/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A�,W� ¬G¬T­@ Gª ��¡ ­@�� °o�q  ��  � � � �|���E�����Q� �E Gªt¨c�E  �)�N����§ � � �

?7��� �/:<!I:��B: ��H;4R#,!"V �.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A� �?7�FE ��#�� �$!"#,> �/�/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A�,�f ')!U�$H;4R!@gh4A:�%;�+�;ij�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A�,�

� �vµ«���E  ¸(µ�§)�Q§¤��µ«  ¶ µ��vº ­,�E�q  �;����� � �q��w���3¦���µY���¢�E¬G�l£ � �Yo·* Gª ­ � kn� �� ¦�µ«�¤�)�Q�¢£ k �Yo

Page 7: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

J2�+�� � � ��� � ����� �

E&��� �h#,';�)Ch:,CL:<!$i�';354A�,�ICP#<QvJ�4R!$\{�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s^E&�FE`?�J�4A!"\�~ '�G: ��:�CL:<!$i�')3K4A� ��#�QT:��;#<�$H;4R!LJ,4R!$\}~ � :�H):,�0�.�/�.�/�.� �BeE&� W�h#,35�+�):�>ntL�+�"H J�4A!"\):�>z3K#&%&� )4A!��/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s�E&� � ?�J�4A!"\ � J,4R!$\ 35#&%&�� Y(R:B�$�+#,� �0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s�E&�F���94R!$\):�>n�;#�')� �.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E�yE&� ^�?�=):�!$C"4/Cb�$!"')(r�"';!$4��/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E;�E&� e`1 �$!"')(r�"';!$4/#<Q��"H;4/=M:<!ICU4A!��/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� E,EW;����|}#�!I% Q #,!"3DCPQ #,!��"H;4/!$#2#<�L>�: G:��B:�:��/�/�.�/�.�/�0�/�/�.�/�.�/�.� W,^W;�FE`Z9:<!I:�%;�+i,3��$:<\)>+40Q #�!� >�:�0:��B:�: �;(r>�:�C$C �/�.�/�.�/�0�/�/�.�/�.�/�.� W,^W;� WG��(r�"��#��):�!"V�#�QT!$#2#<�ICl�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� W,�W;� ��|}#�!I% Q #,!"3DCL:��)% =M:<!I:�%&��i�3��I:<\;>�4.Q #�!L\;HM:�:,1;:�: �/�/�.�/�.�/�.� � yW;�F�`_�#,!"=;H)#�>�#�i���(R:�>�:<�):�>+V2wR4A!��+�;=)'&� � #�'&�$=;'&�l�.�/�.�/�0�/�/�.�/�.�/�.� �M�W;� ^ ~�: �h��#�35=;��>�:<�"��#��O#<Qv=):<!I:�%;�+i,35C���~ \M��_]#�!$=;H;#�>�#�i,��(A:<>z:<�):�>+V&C"��C � � WW;� e`12#,!U�$4A%O!"4AJ�4A!$C"4GC"'��58 �I:<\;>�4��/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � WW;� � ~�: �hXG!$%;4R!$4A%�\;�+�M:<!$V5�"!$4R47:<�M% ~�\M� �q!$��47Cb�$!"')(r�"';!$4AC��/�.�/�.�/�.� �2��)��� �T:<\;>�4/#<QvCU#,3K4.J,4R!$\OC"4A� ';4A�)(r4sC{�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �;��&��� 1 �$!"')(r�"';!$4/#<Qv:<��:�(r�"��#����/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^)��&�FE`pn4AJ�4A>�C����O�"H;47Z9:��;�+�)��:�� 35#&%&4R> �/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^,W�&� WG4rQ�:<')>�� �B:�!$:�� :K(IH):�!U� �/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^,��&� � ��!$:��)CbQ #,!"3D:<�"��#�� !$';>�4AC �/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� ^,��&�F�`_�#,!"40�"!I:<�MCbQ #,!"3D:B�$�+#,� !$';>�4AC/~ Q #,!@(r#,35=;>+4R8�C"4R� �"4A�)(r4sC$� �/�.�/�.� e&��&� ^�_�#&%&� )4R! � 3K#&%&� )4s%�!$4R>�:B�$�+#,�)C�Q #�!hC"4R� �"4A�)(r4sChcK�+���McK�FEx:��)%�cK� W-� e�E�&� e�Z9:<!IC"40CU�"!$')(*�$';!$4GQ #,!hCU4A� �"4R�M(r4/S7��� �.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� e<W�&� ��Z9:<!IC"40CU�"!$')(*�$';!$4GQ #,!hCU4A� �"4R�M(r4/S7�FED�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� eB��&� ��?h�)#<�"H)4R!h=):�!$C"4.Cb�$!"')(r�"';!$40Q #�!hC"4R� �"4A�)(r47S � E]�.�/�0�/�/�.�/�.�/�.� eB��&���Ay ?h>+�"4A!"�M:B�"��J�4/=M:<!ICU4sC0~ :,��:��)% ~�\M��Q #�!��$H;47C"4R� �"4A�)(r47S � W �/�.�/�.� e<�^;��� 1 �$!"')(r�"';!$4/#<Q��"H;47Z9:�!$C"4R! �/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,^^;�FE�G4rQ�:<')>�� �B:�!$:�� :K(IH):�!U��Q #�!� �2H):�:x!I:��2H):�: ���/�.�/�0�/�/�.�/�.�/�.� �,�^;� W ��#��MCb�$!$:��+� �Li�!I:<=;H Q #�!@C"4R� �$4R�)(R4/1��+���/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,�^;� � 12#,>+'&�$�+#,� i�!I:<=;H)C�Q #,!hCU4A�,�$4R�)(R471z�+�5�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �,y^;�F�`?h\)\;!"4AJ2��:<�"��#��)CPQ #,!��"H;4��B:<!I:��B:,Cd�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � E^;� ^�NP�+=M:<!"�"�+�"4/i�!I:<=)H�Q #�!h(R#��)CU�"!I:<��� �Li�!I:<=;H��+� f �+i,';!$4.^)� W �.�/�.�/�.� ���^;� e�_]:<82��3D:<>�~�(R#�35=;>�4r�"4 �L3D:B�I(IH;���;i,C@#<Q[\;��=):<!"�"�+�"4xi�!I:<=;H�#�Q f �+i,';!"4

^;� ^;�q�0�/�.�/�/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � �^;� � 124A35:�� �"��(0�bV =Y4/H;��4R!I:<!I(IH2V �0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �2e

Page 8: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

J2�+���e2��� NP>+#&( � C$(IH;4A35:<�"��(0#<Q9:<�2')C$:<!I:��B: �/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �Ay,�e2�FE�G���z4R!$4R� �h���,�$4R!"Q�:�(R4ACPQ #�!h:��2')C":�!$:��B: �/�/�.�/�.�/�0�/�/�.�/�.�/�.� ���,��;��� gL4A=;!"4sCU4A� �$:B�$�+#,��#�QvC"4R� �$4R�)(R45~ ���P�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �sE,E�;�FE � ��Cb�$!"')(r�"';!$4/:<�)%�Q ��Cb�$!"'M(*�"')!"40Q #�!L=M:�C$CU��J�4.CU4A� �"4R�M(r4D~�^ �]�/�.�/�.� �sE<��;� W�?h��4R8;:<35=;>�40#�Q�';�)�� M(A:B�$�+#,�O#�QqQ ��Cb�$!"'M(*�"')!"4sC��.�/�0�/�/�.�/�.�/�.� �sE�^�;� � c0!I:<=;H !$4R=;!$4AC"4R� �$:<�"��#���#�Qv:xQ ��Cb�$!"'M(*�"')!"4��.�/�.�/�0�/�/�.�/�.�/�.� �sE���;�F��c0!I:<=;H�:<�M% 3D:B�$!"�+8 �;#��$:<�"��#���Q #�!h:5(r#,3K=)>+4R8 Q 4A:<�"';!$4/Cb�$!"'M(*�"')!"4 �sE���Ay)�+� 12#,3K4/4R8;:<35=;>�40���;�+�"��:<>��$!"4A4AC��/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �R� y�Ay)� E gL4sCU';>+�h#<Q9C"';\)CU�"�+�"'&�$�+�;i��������h�������� �/�.�/�.�/�0�/�/�.�/�.�/�.� �R�M��Ay)� W G4R!$�+J,4A%��"!$4R4����rQ #�!� �"H)4/\M#BV C$: t :Ki,�+!$> ���/�.�/�0�/�/�.�/�.�/�.� �R�2E�Ay)� � ���;�+�"��:<>��$!"4A4ACL:,C"C"#&(r��:B�"4s% tL�+�"H �2��( �,4A% �&:<�M% �2��( �,4A% �"H;4/\)')( ��4R��� �R� W�Ay)� � G4R!$�+J,4A%��"!$4R40Q #�!� �"H)4/\M#BV �2��( ��4s%��$H;4/\;')( �,4r��� �0�/�/�.�/�.�/�.� �R�,��Ay)� ^ G4R!$�+JB:B�$�+#,�O�"!$4R4ACPQ #,!� �$H;4/\Y#BV �2��( �,4A% �"H;4/\;'M( ��4r� � �/�.�/�.�/�.� �R�,��Ay)�Fe Z[��(*�$#�!$��:�>�!"4A�)%&4A!"���;iK#<Q9:�% ab#,�+�;���;i5#�=Y4R!I:B�$�+#,���/�0�/�/�.�/�.�/�.� �R� ^�Ay)� � ? %&4A!"��J�4s%��$!"4A47:<�)%O:BQ �$4R!h:�%Bab#����;�+�)iKtL�+�"H�������������� �/�.�/�.�/�.� �R� ��Ay)� � ?h';82��>���:�!"VD�$!"4A4ACPQ #,!L!"4A>�:<�"��J�4/(r>�:<')C"4 �/�/�.�/�.�/�0�/�/�.�/�.�/�.� �R� ��Ay)�+�sy5gL4AC"';>+�h#<Q9:�% ab#,�+�;���;iD:<� :<';82��>���:�!"V5�$!"4A40#,� �!���0�/�/�.�/�.�/�.� �s��y�Ay)�+�,��@4A!"��JB:B�"��#����"!$4R4sCPQ #�!"� � :<�)%#�%$ �.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s�;��Ay)�+� EK?h'&8&��>+��:<!$VD�"!$4R40Q #,!� �$H;#�';i,H ����� �/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �s�,E�Ay)�+�sW5?LQ �"4A!@:�%Bab#����;�+�)i&�'����� �)( �*� ��� �,+-� �/.�0�� 21 .�3 ��� �):��)% �"H;4/!$4AC"';>+����� � � �s��W�Ay)�+�A� f 4A:<�"';!$4/(r#,�)Cb�$!$:��+� �ICPQ #�!h:<i,!"4A4R354R� � �/�.�/�.�/�0�/�/�.�/�.�/�.� �s�<��Ay)�+� �51 �"!$')(*�$';!$4ACL:BQ �$4R!@:,% ab#����;���;iD:<�)%OC"';\)CU�"�+�"'&�$�+#,�O#,=M4A!$:<�"��#��)C �/�.� �s�,��Ay)�+�s^ f 4A:<�"';!$4/(r#,�)Cb�$!$:��+� �ICPQ #�!h:<i,!"4A4R354R� �L:<�)%�35#&%;:<>����bV��.�/�.�/�.� �s��^�Ay)�+�Bex?@% ab#,�+�;���;iDtL�+�"HOQ 4A:<�"';!$4/(r#,�)Cb�$!$:��+� �IC �/�.�/�.�/�0�/�/�.�/�.�/�.� �s������,�+��? �T?hc %&4A!"��JB:B�$�+#,� �$!"4A4�� �0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^�����,� E ? Z�c 35#&%&�� M4R! � 35#&%&� )4A% �"!$4R4��/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^ ����,� W ?h';82��>���:�!"VD�$!"4A4.Q #�!� �"H;#,';i�H � � �.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A^2e�sE;�+� c.Nd_]#2%;4R>7�/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e&��sE;� E c.NdZ !"���)(R�+=;>�4AC��/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� � e&��AW)�+��pn4AJ�4A>�C����O�"H;47Z9:��;�+�)��:�� 35#&%&4R> �/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A�,y�AW)� E c.Nd_]#2%;4R>7�/�.�/�.�/�.�/�/�0�/�.�/�.�/�/�.�/�.�/�0�/�/�.�/�.�/�.� �A�)��AW)� W gL4A>�:<�"��#��)C"H;��=)CL\Y4r�btP4R4R���"4A!"3DC����O�"H;4.�btP#53K#&%&4A>�C��/�.�/�.�/�.� �A� E

Page 9: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

8� � ����� �

��H;��CD\Y# # � =;!$4AC"4R� �IC�: Z9:<�;���;��:<� =M4A!$C"=Y4A(*�$�+J,4 �"#Bt�:<!I%;C5�):<�"';!I:<>h>�:<�)i�'):�i�4=;!$#&(r4AC$C"�+�;i ~ �GpqZP�*�;� �hH):,CP�"H;4.Q #,>+>�#BtL���;iK�"H;!$4R4.#�\;ab4A(*�$�+J,4AC���,� �q#5���,�$!"#&%&'M(r40�"H;4/!$4A:,%&4R!P�$# �@pqZ �E;� �q#5���,�$!"#&%&'M(r40�"H;4/!$4A:,%&4R!P�$#�Z9:<�;���;��:<�Oc0!I:<353D:<!�Q !I:<354At�#,! ��:�=;=;>��+4s%��$#

�"H;4/=;!$#&(r4sC"C"�+�)ix#�Q�35#&%&4R!$� ���)%&��:<�O>�:��;i�'):�i�4sC �W)� �q#u(R#�35=):<!$4 Z9:<�;���;��:<� c0!I:<353D:<! Q !I:<354RtP#�! �utL�+�"H 35#&%&4R!$��| 4sCb�$4R!$�

(r#�35=;';�$:B�$�+#,�):<>zi,!$:�3K3D:�!�Q !I:<354At�#,! �&CA���H2')C����$H;4@=;!$#�=Y#,C"4A%5\Y#2#��5354R4R�$C �bt�#7i,#,:�>�C[:<� �$H;4GC$:<354L�$�+354��L~U�s�9� ��=;!$#BJ2��%&4sC:<�-�+� �"!$#&%&')(r�"��#����$# �@p�Z�Q #�!0���)%&��:<�->�:��;i�'):�i�4sC��"#OCb�$')%&4R� �IC0:��)%OQ�:�(R';>+�bVOtLH)#:<!$4��;#<�[���;�+�"��:B�$4A%x�"# �GpqZ �,:<�)% ~ E,�T� � :�(r�$C[:,C9:/CU#,';!$(R4�\Y#2#��x#��D(r#,3K=)'&�$:<�"��#��):�>Z9:<�)�+�;��:<� Q !$:�354RtP#�! �D\;!"���;i,�+�;iD:�>+>z�$H;4/3D:B�"4A!"��:<>���� #��;4.=;>�:�(R4����H;4 )!$CU�GHM:<>+Q #<Q9�$H;4x\Y#2#�� =;!$4AC"4R� �$C0: (R#�35=;'&�I:B�$�+#,�):<>�i�!I:<353D:<!h�$H):B�.H):,C

\Y4R4R� %;4RJ�4A>+#,=M4s%]Q #,!7=;!$#&(r4AC$C"�+�;i #�QP���)%;��:��}>�:<�)i�'):�i�4ACA�D���)%&��:<��>�:<�;i,'):<i,4AC0>�� �,43D:<�2V�#<�$H;4R!/>�:<�)i�'):�i�4ACG#<Q��"H;45tP#�!$>�%-H): J�4K!$4R>�:B�"��J�4A>+V Q !$4R45tP#�!I%�#�!I%&4A!A� ��H;4RV:<>�C"# HM: J�4 : !"��(IH CUV&CU�"4R3 #<QD(R:�C"4 � 4R�M%&�+�)i,C�:<�M% =Y#,CU� � =Y#,C"���$�+#,�)C ~�(R#�>�>+4s(*�"��J�4A>+V(R:�>+>�4A%� {����� ��}�{ �*�x���-(r#,�,�$!$:,Cb�G�"# �"H;��C �z�$H;4K35:<ab#�!$���bVO#<Q�i�!I:<353D:<!LQ !I:<354RtP#�! �&C:<!$4�%&4AC"�+i,�;4A% Q #�![6 �;i�>���CUH5:<�)%x#<�$H;4R!9=Y#,C"�+�"��#��):�>&>�:��;i�'):�i�4sCR� ��H)4RV :�!"4�4r82�$4R�)%&4s%:�C/:�� :BQ �"4A!U�$H;#�')i�H �/�"#�H):��)%&>�45Q !"4A4 � t�#,!$%-#�!I%&4R!/>�:<�)i�'):�i�4AC��n')C"'):�>+>�V]=): V2���;i�:=;!$��(R4L\M#��"HD���D4R>�4Ri :<�)(R4h:�C9tP4R>�>):�C[�+�D=;!$#&(r4sC"C"�+�)i04 ��(r��4R�)(RV�� ��H;4L';�;��� ';4@:,CU=Y4A(r�#<Qq�"H;4/(r#,35=;'&�$:<�"��#��):�>zi�!I:<353D:<!�%;4AC$(r!$�+\Y4A% H;4R!$4G��C��"H):<�L������CL%;4AC"�+i,�;4A%�Q #�!�Q !"4A4tP#�!I%�#,!$%;4R!h>�:<�;i,'):<i,4ACL:��)% 3D:���4sChC"=M4s(r��:<>q'MCU47#�Q9J ��\;H):�� �"� �L� �h�$:���4ACL�"H;4K(r#�� �(r4A=&�7#<QPJ2�+\;HM:�� �"�[:��)% �B:�!$:�� :�!$4R>�:B�"��#��MC@Q !$#�3 Z9:<�;���;��:<� Q !$:�3K4At�#,! � ��:<�M%-')C"4AC�"H)4R3 �"#�i���J�4 :��-4A>+4Ai,:<� �G:,(R(R#�';� �@#�Q ���)%&��:<�]>�:<�)i�'):�i�4ACA�@6 �D(R�+4A� �G=):�!$C"4R!ICLQ #,!�"H)4Ki,!$:�3535:�!G:�!"4K:<>�CU# %&4AC$(r!$��\M4s%�� ��H;45(r#,3K=)'&�$:<�"��#��):�>Ti,!$:�3535:�!@��C0>+� ��4A>+V �$#\Y47CU';�+�$:�\;>�4GQ #,!h#<�$H;4R!�Q !$4R4.tP#�!I%�#,!$%&4A!L>�:��;i�'M:<i�4sC #�Q��$H;4/tP#�!$>�%��

Page 10: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

82���H):�=&�"4A!K�D%&��C$(r')C$CU4sC/:<=;=)>+��(R:<�"��#��)C/:��)%-��C$CU';4sC.�+� �@:<�"';!I:<>[p�:<�;i,'):<i,4KZ !"# �(r4sC"C"���;i ~ �GpqZP�*�A? H;��Cb�$#�!$VG#�Q2!$4R>�4RJB:��,����%&4s:�Cq�+� %;���z4R!$4R� �T%;��C$(r��=;>��+�;4sCn��C�%;��C$(r')C$C"4A%

���]\;!$�+4RQb� ��H;��Ch��ChQ #,>+>�#Bt�4s%O\ V��"H)4 =;!$4AC"4R� �GC"V23 \;��#,C"��C@#<Q9��%&4A:,CLQ !$#�3 (r#�35=;';�"4R!C$(r��4R�)(R4�:��)%7>����;i�';��CU�"��(RC��<>+4s:�%&���;i0�"#/C"#�354P#<Q)�$H;4�35#2%;4R!$�xi,!$:�3K3D:�!qQ #,!"3D:<>���CU3DCA�

��H):�=&�"4A!xE ���,�$!"#&%&'M(r4AC/�"H;4OCb�$!"')(r�"';!$4�#�Q�>�:<�)i�'):�i�4D:<�)%�=)!"4sCU4A�,�IC7:<� #BJ,4R! �:<>�>�:�!$(IH)���$4A(*�$';!$4/#<Q9#�';!GCUV&CU�"4R3�Q #�!G:<�):�>+V2wR���;i�C"4R� �"4A�)(r4sCh�������)%&��:<��>�:<�;i,'):<i,4ACA�Z[!$#�=Y4R!"�"��4AC�%&4sCU��!I:<\;>�4G����(r#,3K=)'&�$:<�"��#��):�>Yi,!$:�3535:�!$C�:�!"4.:<>�CU#5%&��C"(R')C$CU4s%�����H):<= ��"4A!7W�%;��C$(r')C$C"4AC035#�!$=;H;#�>�#�i,��(A:<>T:<�):�>+V&C"��C��n:<�)%-H;#Bt : C"�+35=;>�4x\)'&�74 ��(r��4R� �7:<� �:<>�V2wR4A!�(R:<�l\Y4]\;')�+>+�A� ��H):�=&�"4A!�� %&��C"(R')C"C"4AC�>+#&(R:�>htP#�!I% i,!"#,';=;���;i��+�l���M%&��:��>�:<�;i,'):<i,4ACA� ��H)4x:<��3 #<Qv�"H)��CG=;!$#2(R4AC$Ch��CL�$# i�!$#�')=]CU4s�,')4R�)(R4ACh#�Q9t�#,!$%;Ch�"#�=)!"# �%&')(R4DJ2�+\;HM:�� �"�9Q #,!/�;#�')�)C/:<�)%}J,4R!$\)CR� ��H;4sCU4DJ2��\;H):��,�$��C/:�!"45')C"4A%}���}�"H;4D�;4R82�CU�$:<i,4.#<Q�=M:<!ICU���;i)�

��H):�=&�"4A!$C ��:��)%l^ :�!"4 �$H;4]3D:<���u(IH):<=;�"4R!ICD#,��Z9:��;���;��:��uc0!$:�3K3D:�!A� �����H):�=&�"4A!x���q�"H;4D�;#��"��#��)C.#�Q �B:�!$:�� : (IH):�!U�IC � � :�!$:��B:O:,C"C"��i��;354R� � �n4r�I(<� :�!"4D%&��C �(r'MC"C"4A%��-� �x��C :<!$i�')4A% :<�M% CUH;#BtL���$H):B�5:]i,!$:�3K3D:�!/\):�C"4A%�#,� �"H;4sCU4��;#<�$�+#,�)C��C"')(R(R4AC$CbQ ';>�>�VKHM:<�)%&>�4AC �B:<!I:��B:/!$4R>�:B�$�+#,�)C��2(R#�� �"!$#�> �2:�(*�$�+J,4 � =):�C$C"�+J,4AC��<4r�I(<����H):�=&�"4A!^@%;��C$(r')C$C"4ACq(R#��)CU�"!I:<��� �q\):,CU4s%.=):<!ICU���;iLQ #,!n�$H;4PZ9:��;���;��:�� c0!$:�3535:�!A�q� �T%&��C"(R')C$CU4sC:�i,4R�;4A!$:�>q=;')!"=Y#,C"4 =):�!$C"���;i :<>�i�#,!"�+�"H)3 ��:,C@tP4R>�>T:,CG: 35#�!$4 4 ��(R�+4A�,�.:<>�i�#,!"�+�"H;3Q #�!D:-!"4sCb�$!"��(*�$4A% (R>�:,C"Cx#<QGi�!I:<353D:<!ICR� f �+�):�>+>�V �PCU#,354�:<=)=;>+��(R:<�"��#��)CK!$4R>�:B�$4A%��$#3D:�(IH;���;40�"!I:<�MCU>�:B�$�+#,�O:�!"4.%&��C"(R')C"C"4A%����]��HM:<=&�$4R!Ge2�

124s(r#��M%]H):�>�Q #�Q �$H;45\M#2#���=)!"4sCU4A�,�IC.:�(R#�35=):<!$��CU��#��]#�Q�Z9:<�)�+�;��:<�}c0!$:�3K3D:�!~�ZPc/�/tL�+�"H 4R8&��CU�"���;i]35#&%&4R!$� |}4ACU�"4A!"� i,!$:�3K3D:�!/Q !$:�354RtP#�! �2CA� � �x��� �"!$#2%;')(r4sC�"H)!"4A4/| 4sCb�$4R!$��i�!I:<353D:<!�Q !I:<354RtP#�! �&C�'MCU���;iD4r8;:�3K=)>+4sC�Q !"#,3 6 �;i�>���CUH ��pn4r8&��(R:�>f ')�)(*�$�+#,�):<>2c0!$:�3K3D:�! ~�p f c/� � ��!"4A4[?@% ab#,�+�;���;iGc0!I:<353D:<!�~ �T?hc/� � :<�)%7c0#BJ,4R!$���354R� �9:<�)%xN����)%&���;i5~ c.NL�*����H)4�=;!$4AC"4R� �I:B�"��#��x%&#24AC��;#<�9:�C$CU')3K4�:<�2V.\):,( � i,!"#,';�)%#��}=):�!U�/#<QP�"H)4D!"4s:�%&4A!0!$4Ri :<!I%&���;i��$H;4AC"45Q !$:�354RtP#�! �2CA�xg@:B�"H)4R!/�$H):<� �"!$V2�+�;iO�$#i���J�4/:5(r#,35=;!"4AH;4R�MCU��J�4.(r#BJ,4R!I:<i�4@#<Qv4A:�(IHO#<Q��"H;4.Q !I:<354At�#,! �&C����$H;4/=;!$4AC"4R� �$:<�"��#��\;!$�+�)i,C7#,'&�xC$:<>���:�� � =M#,�+� �IC :<\Y#�';�x4A:,(IHn�]6 :,(IH�=;!"4sCU4A� �$:B�$�+#,����C Q #�>�>+#BtP4A%}\2V�:(IH):�=&�"4A!�(R#�� �$:��+�)�+�;iK4R�+�"H)4R!h:5%&��C"(R')C"C"��#�� #,�O:�=;=;>���(A:<\;��>����bV�#�Qq�$H;40Q !$:�3K4At�#,! �K�$#���)%&��:<��>�:<�)i�'):�i�4ACh�+��=):�!U�$��(R';>�:<! ~ :<�)%OQ !$4R4� tP#�!I%O#�!I%&4R!h>�:<�)i�'):�i�4AC��;����i�4A�;4R!I:<> �#�!h:5(R#�35=):<!$��CU��#���tL���$H Z9:��;���;��:��Oc0!I:<353D:<!�Q !I:<3xt�#,! �z���H;4�3D:<�"4R!$��:<>[�����"H;��C7\Y#2#��}H):�C7\M4A4R� (r>�:�C$C.�$4ACU�"4A% �+� !$4Ri,';>�:�!7(r#,';!$C"4AC.#,�

�@p�Z�:<�KN0� �q4s(IHn� ��_ � ��4A(IHq��:��)% Z Hn� �v>�4RJ�4A>P:<�K�*� �*� �.� �/:��;=;';! �[:<�M% %&';!$���;iC"4RJ�4A!$:�>[CUH)#�!"� � �"4R!$3 ��� �"4A�)CU��J�4�(r#�')!$C"4AC.#,� �@pqZv� ��H;4�3D:B�$4R!$��:�>[��C C"';���I:<\;>�4DQ #,!:<�2V2\Y#2%;V �+� �"4A!"4sCb�$4A% �+� �@p�Z tLH;#�H):�CK#��)4O#�Q@�btP# \M:�( �2i�!$#�';�M%;C ��(r#�35=;';�"4R!C$(r��4R�)(R4O#,!5>+���;i�')��CU�"��(RCA�l?@(*�$'):<>�>�V � tLHM:B����C5!"4s:<>�>+V �;4A4A%&4s% ��C �� � }�{~}������&�*���� ���� � ��� :<�)% �� �� �� }�{�� � �8{~��� �K1&#�354R\Y#&%&V�tLH;# =M# C"C"4AC$C"4AC@�"H;4sCU4K\;'&�/�;#���"H)4/\):�( �2i�!$#�')�)%�tL��>+>nCU�"��>�>n\M47:�\;>�4.�"#KQ #�>�>+#Btd�"H;4/3D:<�"4R!$��:<> �

�G�+�)4R4r�0��HM:<�+�$:<�2V :g@:Bab4R4AJ�1&:��;i,:�>

�/:<�)=;';! ';�;45�A�,�<�

Page 11: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

8&���+�� ����� ��� �G��� � ��� � ����

_�')(IH5#�QM�$H;��C[35:<�"4A!"��:<>&H):,C9\Y4R4R�D%&4AJ�4A>+#,=M4s%x#BJ,4R!T�"H)4hV�4s:<!IC�\2V �"H;4L!$4AC"4A:�!$(IH%&#,�;4 \ V #,';!Di�!$#�')= �[��� tLH;��(IH >�:�!"i,4 �2';3 \Y4R!D#�Q0CU�"')%;4R� �$CD:��)% =)!"#�ab4A(*�DCU�$: �H): J,4 \Y4R4R�}��� J,#�>�J�4s%�� 12#�354K#<Q��"H;4K�):<354sCG#�Q�=Y4R#,=;>+4K���)(r>�')%&���;iO�"�+�">�4AC.#�Q[�"H;4A�+!�"H)4AC"4AC :��)%�=):�=M4A!$C�(A:<�l\Y4]Q #,';�)%����u!"4RQ 4R!$4R�)(R4AC�:<���"H)4-4R�M%�� _]:<�2V #<�"H)4R!IC(r#,� �"!$�+\;';�"4A%]\ V�:,C �2���;i � ';4ACU�"��#��MCG:��)%�!I:<��CU���;i���C"C"';4sCR� ��H;4AC"4 ���)(r>�')%&4K:B�0>+4s:�CU�C"4RJ�4A�x\M:B�$(IH)4ACv#<Q�CU�"')%&4A� �$C9#�QzN0� �q4s(IHn�T:��)%K_ � ��4A(IHq�TtLH)#.%;��%5(r#,';!ICU4sCv#����@pqZv�?h>�C"#]�+�M(r>�')%&4A% :<!$45�"H;4�=M:<!"�"��(r��=):<� �$C7#<Q@C"H;#�!"�/�"4A!"3�(r#,';!$C"4AC7#�� �@p�Z H;4A>�% :<��U� ��� %;';!"���;i-�"H;4OCU';35354R!ICx#<Q7�A�,��y ���s���;���9:<�)%l�s��� E��v:<�)% :<�K�@�;�+J,4R!ICU�+�bV}#<QShV&%&4A!$:�\):�%���� :<�2'):�!"VD#�QP�s���,E :<�)%}�s����W)�

_]:�� V-J ��C"���$#�!IC0:��)%�(r#,>+>�:<\Y#�!I:B�$#�!IChH): J,45:�>�C"# (r#�� �$!"��\;'&�$4A%}�+� %&4AJ�4A>+#,=;354R� �#<Q0�"H)4��"H;4A#�!$V���12=M4s(r��:<>h354A�,�$�+#,��3 ')CU� \Y4]3D:�%&4�#�Q G!A� �5� �x��gh:�3D:��2!"��C"H���):�35:,(IH):<!$V2';>�'�#<Q gh:,CUH �"!$��V,: 1&:��)C � !$�+� �@��%&V,:�=M4A4r�$H): � ����!"';=M:B�"� �ztLH;# HM:�C0(r#�� ��"!$��\;'&�"4s% �"# �"H)45�"H;4A#�!$V]�+� : 3D:Bab#,!.tP: V,��Sh4D��C0�"H;4�(R# ��:<'&�$H;#�!.#<Q@��H):�=&�"4A! �:<�M%�?@=;=M4A�)%&�+8 ? �

|}4Lt�#,';>�%x>�� �,4��$#.�"H):�� �xZ !"#�Qb��N0� �7��Z9:<�"�):�� �/Q #,!9H;��C[CU')=;=M#,!U�v�$#.�"H;��C94R� �$4R! �=;!$��C"4x:��)%�Q #,!0%;��C$(r')C$C"�+#,�)CG%;';!"���;i��"H;4K4A:�!">�V�Cb�I:<i,4ACh#�Q[�"H)4xtP#�! �z�0|}4K4R�Bab#BV,4A%#�')! ���,�$4R�)C"4 %&��C$(r')C$CU��#��MC :<�M% :<!$i�';354A�,�IC/#�� c0#BJ,4R!$�;354R� �x:��)% NP�+�)%;�+�;i tL���$HZ[!$#<Q�CA� Z !"#,\):<> G:,CUi,';=&�I: � �5� ?7� : V :�C"4R4R>�:<� :��)% g/�9?h35!$���I: JB:<>�>+��%&';!$�+�)i]�"H)4354R35#�!I:<\)>+47C"H;#�!"���"4A!"3 (r#,';!$C"4.#�� �@p�Zu:B�@S@V&%&4R!I:<\):,%O�+� :<�2'):<!$V]�s���,E;�[|}4:<!$4[�$H):<� �,Q ')>,�$#GZ !"#�Qb���7� �7�<12���;i,H7#<QM�@�;��J�4R!IC"���bV.#<Q)S@V&%&4R!I:<\):,%.Q #�!T3D:<�2V.�+� �$4R! �4ACU�"���;iK%&��C$(r'MC"C"�+#,�)CP:<�)%�CU';=)=M#,!U�s�T|}4.:<>�CU#7tL��C"H��"# �"H):�� ��Z[!$#<Qb�v6h�&?@�;�):<3D:�>�:��#<Q ��4R� �$!$:�>L���)Cb�$���$'&�"4-#<Q.���)%&��:<�lpq:��;i�'):�i�4sC �P_�V&CU#,!"4�� @!s� cK���@3D:<3D:<H;4sCUH �t�:<!Gg@:<# ��Z9:��)(IH):<�M:<��_�#�HM:<� �bV �zZv� g7��0:�%;4Ri,:�#�� �B:�!��Y:<�)%-c.:�'&�$:�3 124R�;i,';=&�I:#<Q �@�;��J�4R!ICU�"��V�#�Q ShV&%&4R!I:<\M:�% ��@!s�01��Ygh:<ab4R�)%;!$:���#<Q �T:<35�+>v�h�)�+J,4R!ICU�+�bV ����H):<� �aU: J2';! � @!ICR� ?7�F1z�Tgh4A%;%&V�:<�M% �@:�!$: V :<�):�3 ';!"�"H2V�#<Q@? � �*�vpq:�\n� �v�@�;��J�4R!IC"���bV #<QShV&%&4A!$:�\):�% � Z !"#�Qb�T?@�):<� �"HM:<�):�!$: V :<�):0#<Qq_]V2C"#�!$4 ~ Q #�!$3K4A!">�V5#<QTX0C"3D:<�;��:,� � :��)%G!A� ��H):��2';! G:,C"C�#�Q �.4A�)%&!$�+V :xS@�+�)%;�T1&:��)Cb�$H):<� �;?hi�!I:;�

_]:�� V�=Y4R#,=;>+4}H): J,4-\Y4R4R� �+�2J,#�>�J�4A%u�+�d�"H;4}�+35=;>�4R354A�,�I:B�$�+#,�d#<QKZ9:<�;���;��:<�=):�!$C"4R!v:<�)%x:<�2')C$:<!I:��B:L:<35#,�;i@���)%;��:��x>�:<�;i,'):<i,4ACA� ��H;4PQ #�>�>+#BtL���;iG=M4A#�=;>�4�=)>�: V,4A%:�3D:Bab#,!n!"#,>+49���.�"H)4[4A:�!">��+4A!�J�4A!$C"�+#,�)Cz#<Q2�$H;4[��3K=)>+4A3K4A� �$:B�$�+#,� �q12��JB:�C"';\;!I:<3D:<�;��:<� �N0��12!$�+�;��JB:�C���Zv� � �<gh: J2��C":�� �B:<! � :��)%KN�!I:Bab4sCUHKZ9:<�)%;4�� ��H)4�(R';!$!"4A�,�v��3K=)>+4A3K4A� �$: ��"��#��OH):,C�HM:�%�3D:<ab#�!�(r#�� �$!"��\;'&�$�+#,�)C�Q !"#,3 �9_�!ICA�v?@3 \):KZv� �.';> � :�!"�)� � �[:,CU')%;4RJB:�94R!$3D: �T:<�)% � � �7� �@:<!I: V,:��):;� ��H;45Q #�>�>�#BtL�+�;i =Y4R#,=;>+4DHM: J�4Kt�#,! �,4A%]#,��\;';��>�% ����;i]:<�)%�(IH;4s( �2�+�;i >�4r8&��(R:<>[%):B�$:�\):�C"4AC0Q #,! :<�2')C$:<!I:��B:�:<�)%�Z9:<�)�+�;��:<�}=):�!$C"4R!.Q #,!Sh���)%&� � �/:<�)�):�%;: � ��4R>�';i,' � ��:�3K��> �Y4R�$(�� �@gh4 �2H):�1&!"��JB:�CU�$: JB: ���h4A4R>�:<3 �q!$��=):B�$H;� �Z['MCUH;=M: 1&:B8&4A�): �Y?h> � :O12!$�+JB:�CU�$: JB: ���/:<3D:�>�:�c.:��;i,:,%&H):<!I:<��V,: �;gh:Bab4sCUH2t�:<!$�qgh: �3D:�C"4AC"H):<� �v12')i�';�):}1&:B�$H2V,:<3x';!"�"H2V�� G!A� GH):��;4R�)%;!$: �5� HM:�H):�C H;4R>�=Y4A% ')CtLH;4A�;4RJ,4R! tP4@HM:�%�:x�,')4ACU�"��#���#,�D�"H;40Z9:<�;���;��:<�DJ2��4Rt��"#Bt�:<!I%;C�:7>�:<�;i,'):<i,4L=;H;4 ��;#,3K4A�;#��q�]_�!$CA��?h3x\):-Zv� �.';> �B:�!"�;� � C7(r#,�,�$!"��\;'&�$�+#,�)C7�)4R4A% C"=Y4A(r��:<>�354R� �"��#�� �

Page 12: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

y%&4AJ�4R>�#�=)�+�;i-=;!"#,i�!I:<3DC���3D:<�M:<i����;i��$H;4O\;';��>�%&���;i}#<Qh>�4r8&��(R:<>�%;:<�$:<\M:�C"4AC��v:��)% ���=;!$#BJ2��%&���;iK�;4Rt ��%&4A:,CL:B�h\Y#<�"H >��+�)i�';��Cb�$��(.:��)% CUV&CU�"4R3{>+4AJ�4R> � 12H;4/HM:�CL:<>�C"#K\Y4R4A��"H)47CU#,';�)%&���;i5\M# :<!I%�Q #,!L3D:<�2V���%&4A:,CR���H;��Cq3D:�� 'MC"(R!"��=&�qH):,Cn\Y4R4A� =;!$4R=):�!"4s%.tL���$H C"4A(r!$4r�I:<!$��:�>�:�C$C"��CU�$:��)(r49Q !$#�3 _�!ICA�

?hwA!$:D12H)�+!$�+�q�12';=)=M#,!U�9Q #,!9�"H;4L!$4AC"4A:�!$(IHxt�#,! �x%&4AC$(r!$�+\Y4A%KH;4A!"4LHM:�C9(r#,354�Q !"#,3�_����;��Cb�$!"Vx#<Q

Sh')35:���gL4AC"#�')!$(R4 @4AJ�4R>�#�=)3K4A� �@~�_]SGg 0� � @4A=):<!"�"354R� �[#�Qn1;(r��4R�)(R4@:<�)% ��4A(IH ��;#,>+#,i�Vd~ 01 �h� ��:��)% @4A=):<!"�"354R� � #�Q.6 >+4s(*�$!"#,�;��(AC�~ /X06��K#�Q/c0#BJ,4R!$�;354R� �D#<Q���)%&��:;� /X06uCU')=;=M#,!U�$4A%��"H)4x� � t�4A4 ��>+#,�;i�(r#,';!$C"4AC�#,� �@pqZ �M�+��tLH)��(IH�3x')(IH #<Q�"H)��CG3D:B�"4A!"��:<>Tt�:�Ch=)!"4sCU4A�,�$4A% ���]Q !$#�� �@#�Q[>+���;i�')��CU�$C@Q !"#,3 :<>�>�#BJ,4R!L�$H;4K(R#�';� �$!"V��Q #�!0�$H;4 M!$CU�G�$�+354,� 01 � =;!$#<ab4s(*�G=)!"#BJ2��%&4A%]C"';=;=Y#�!"�0Q #�!/(R:�!"!$V2�+�;i #�'&�.�+�2J,4ACU�"� �i,:<�"��#��)CP(r#,35=):<!$�+�)i �$H;4/Z9:<�;���;��:<��c0!I:<353D:<!/~�ZPc/�[tL�+�"HO�$H;4.3K#&%&4A!"��| 4sCb�$4R!$�(r#,35=;'&�$:<�"��#��):�>2i�!I:<353D:<!ICR�qZ !"#�Qb��g/� �G:<!I:�C"�+35H):��x:�Cv(IH):��+!$3D:<�7#�Q)�$H;4LCb�$4R4R!$���;i:<�M% 4AJB:<>�'):B�$�+#,��(R#�3535���$4R4�#�Q��$H;4�=;!$#<ab4s(*�73D:�%;4DJ :�>+'M:<\;>�4�CU')i�i�4sCb�$�+#,�)C/:<\Y#�';�tLH):<�K�;4A4A%&4s% �$# \Y4�%&#��;4 :B�5JB:<!$�+#,')C@ab';�)(*�$';!$4ACA� ���)%&��:<�l12#&(r��4r�bV�#<Q ��4A(IH)�;���(R:�>)6 %;')(R:<�"��#���~ �U1 �L6P�T#<Qn_]SGg u=;!$#BJ2��%;4A%KCU';=)=M#,!U�9Q #,![=;!$4R=):�!$:<�"��#��K#<Q�(r#�')!$C"43D:B�$4R!$��:�>&#��5Z9:<�;���;��:<�Kc0!I:<353D:<!v#,�xtLH;��(IHK�"H;4 M!$CU�[CU4AJ�4R�5(IH):�=&�"4A!$Cv:<!$4�\):�C"4A%n�

�G�+�)4R4r�0��HM:<�+�$:<�2V :g@:Bab4R4AJ�1&:��;i,:�>

�/:<�)=;';! ';�;45�A�,�<�

Page 13: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ������� � �

� ��� � � � � � � ��� ��� � � �

��� � %w53. �����g4653'��8%��H;45i�# :<>T#<QP�):B�$';!$:�>v>�:��;i�'):�i�4x=;!"#&(R4AC$CU���;i ~ �@p�Z��G��C0�$#�\)';�+>�%�(r#,3K=)'&�$:<�"��#��):�>35#&%&4R>�CD#<Q0�):B�$';!I:<>L>�:<�;i,'):<i,4 Q #,!D���IC�:<�):�>+V&C"��CD:��)% i�4R�)4R!I:B�"��#��q� f ��!$CU�����"H)4R!$4��C7�$4A(IH;�;#,>+#,i���(R:�> 35#<�$�+JB:B�$�+#,� #<Qh\)';�+>�%&���;i}�+� �"4A>+>���i�4R� �5(r#�35=;';�"4R!5C"V2CU�"4A3DC C"')(IH:�C.3D:,(IH;�+�)4x�$!$:��)C">�:<�"��#�� C"V&Cb�$4R3DC��n�):B�$';!I:<>v>�:��;i�'M:<i�4K���,�$4R!"Q�:�(R4ACG�"#�%;:<�$:<\M:�C"4AC��3D:<��� 3D:�(IH;���;4����,�$4R!"Q�:�(R4ACv�$#7(r#�35=;';�"4R!ICv���Di�4R�)4R!I:<> �<CU=Y4R4s(IHK')�)%&4R!ICU�$:<�M%&�+�)i7CUV&C ��"4A3DC �,�"4R8 �P:<�):�>+V&C"��C[:��)%5';�)%;4R!ICb�I:<�)%&���;i7C"V&Cb�$4R3DC � (r#,3K=)'&�"4A!�:<��%&4s%x���)CU�"!$')(*�$�+#,�C"V2CU�"4A3DC �[C"V&Cb�$4R3DC7�$H):B�K!"4s:�% :��)% ';�M%&4R!ICb�I:<�)% =;!"��� �"4s% #�!xH):<�)%;tL!"�+�U�$4R� �$4r82�A�124s(r#��M% ���"H)4R!$4x��C/:�(R#�i,�;���$�+J,4K:��)% >+���;i�')��CU�"��( 35#��"��J :<�"��#�� �"# i,:��+�}: \Y4r�"�"4A!/�+���C"�+i,H,�L��� �"#5H;#BtdH2';3D:��)Ch(r#,353 ';�;��(R:<�"4.')C"�+�)iK�M:B�"')!$:�>�>�:��;i�'):�i�45~ �Gp��*���H;4P�"#2#,>�CT#<QYt�#,! �/��� �@p�Z :�!"4Pi�!I:<353D:<!TQ #�!$3D:<>���C"3DC �<:�>+i,#�!$���$H;3DCv:<�)%K%;:B�I:

CU�"!$')(*�$';!"4sC �YQ #,!"3D:<>���CU3 Q #,!0!$4R=)!"4sCU4A�,�$�+�)i�t�#,!">�% �2�;#BtL>�4A%;i�4 �z!$4A:,CU#,�;�+�)i�354A(IH): ��;��CU3DC��q4R�$(<�D_]:��2V]#<Q��"H;4sCU45H): J,4x\Y4R4A� �I:��,4R� Q !"#,3 :<�)% ���;H;4R!$�+�7!"4sCU';>+�$CGQ !$#�3��#�35=;';�"4R!K1&(r��4R�)(R4 �v?h!"�"� M(r��:<> ���,�$4R>�>+��i�4A�)(r4���pq�+�;i,';��Cb�$��(AC �Tpn#�i,��( ��:��)%�Z[H;��>+# CU# �=;H2V��� ������� Y dTabL�n��>A1ab_`]pL$:<_o_ ]pHKjlA FEHpdTJo=pn4R�h')C )!ICb�h>�#2#�� :<�hCU#,3K4.4R8&:�35=;>+4/:�=;=;>���(A:B�"��#��MC�#<Q �GpqZv�¸(�Q§¤¥c���E¦ ¦��q ��«¥ �)��­��� l§)­W��¶ �E¡ ­@�©§)µDªG�Q§¤� �G�q�)­@���#�35=;';�"4R!IC/H): J,45\M4A4R��tL��%;4R>�V-')C"4A%}�$#]Cb�$#�!$45:��)%}3D:<�):�i�45>�:�!"i,4D:<35#�';� �IC.#<Q%;:<�$:;� ��H;4L%;:B�I:@35��i�H �v=M4A!U�I:<��� �$#G!I:<��>+t�: V.!"4sCU4A!"JB:<�"��#�� � >��+\;!I:<!$V � \):�� �2�+�)i �<3D:<� �:<i,4R354R� �q���&Q #,!"3D:B�$�+#,� �B:<�)%/C"#h#,�n� �@#�!$35:�>+>�V �s�$#h')C"4[�"H)4AC"4�C"V2CU�"4A3DC � CU=Y4A(R��:�>+��wR4s%(r#,35=;'&�"4A! �2�;#BtL>�4A%;i�4 ��CG�;4A(R4AC$C":�!"V,� ��H;4xi�# :<>T#<Q[�):<�"';!I:<>T>�:��;i�'M:<i�4 �+� �"4A!UQ�:,(r4sC~ �Gpn�U����C �$#x!$4R35#BJ,4h�"H)��CP\):�!"!$�+4A!A� ��H;40')C"4R!���CP4R82=Y4A(r�"4s%��$#x��� �"4R!I:�(r�������M:B�"')!$:�>

Page 14: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

E �������������� ������������������������������ !�

>�:<�;i,'):<i,4]~ \2V 354s:<�)C #<Qh: ��4AV2\M# :<!I%}:��)% :]C$(r!$4R4A�M�*� f #,! 4R8&:�35=;>+4��T�"# �2�;#BttLH;4R�"H;4A!@:K\M#2#���\2V�Z9:B�I:<�BaU:�>+����CL: JB:<��>�:�\;>�40���O�"H;4 >+��\;!I:<!$V �2�"H)4/')CU4A!Lt�#,';>�%O:,C ���� �@p � ��H;4@!"4A=;>+VKtP#�';>�%�:<i :<���5\M4G�+� �Gp �2:<�)C"tP4R!$�+�;i/tLH)4r�"H)4R! �+����CP(R:B�I:<>�#�i,';4A%\;'&�0��C$C"';4A%O�$# :5')C"4R! �)��Ch�;#��G:<35#��)i5�"H;4xH;#�>�%&���;i,C��)��C@(R';!"!$4R� �$>+V�3K��C"=;>�:,(r4s% �)#,!��C�#��O�"H;4/C"H;4R>+Q9:<�)%O�+�$C��2';3 \Y4R!L��ChC"#D:<�)%OCU#M�9pn� f 6 g \2V�Sh4A�)%&!$��8}~b�A�2eB� � :��)%� � �L6�pqp�6P� �u\2V SG:<!$!"��C.~b�s� e�e��[tP4R!$4/CU#,3540#�Q��$H;4/4A:�!">�V�C"V2CU�"4A3DCR�¸(�Q§¤¥c���E¦ ¦��q ��«¥ �)��­��� l§)­W��¶ �E¡ ­ §)µ�¡ µ«�D¬3¥c§¤­s���12#,3K45i,4R�;4A!$:�> �@p����,�$4R!"Q�:�(R4ACG�"#](R#�35=;'&�$4R!IC.H): J�45:<>�CU# \Y4R4A��%;4RJ�4A>+#,=M4s%����0���C"H;#�!"��Q #�!h� �@� � (r#,�)CU')>��I:<� ���;%&4AJ�4A>+#,=M4s%�:<�LNP4A! �,4R>�4RV]~ |l��>�4R�)C �2V �n�s���,E,� :,C"C"��Cb�IC:��)4Rt ')C"4R!G�"# � �@� ��#,=M4A!$:<�"���;i�C"V&Cb�$4R3 �.���-(R:,CU4x#<Q�: =;!$#�\;>�4R3 �"H)4x')C"4R!.(R:��C"4R4 �K�+�$CP:�C$CU��Cb�I:<�)(R4��T� ��4A�;i,:�i�4AC[H;�+3 #,! H;4A! ��� : %;��:�>+#,i�';4h:��)%5�"!$��4AC �"#/�$4R>�>YH)�+3#�! H;4R!xtLH):B�/�$#-%&#)� � � 'MCU4sC7C"(R!"��=&�IC :<�M% �2�;#BtL>�4A%;i�4�:<\Y#�';� ')C"4R! � C/i,#,:�>�C/:��)%=;>�:<�)CA�" ¥G­@��§¤��µ«  �q  �)¹ ­W���� T�D��£M�)§)­@���124AJ�4R!I:<>nC"V&Cb�$4R3DCLH): J,4/\M4A4R��\;')�+>+�G:�Ch!"4sCU4s:<!I(IH�J,4RH;��(r>�4ACL��� �@p�Z�tLH;��(IH]:<�)C"t�4A!� ';4ACU�"��#��MCL:<\Y#�'&�@:5%&#,35:��+�q�[pq� �G?@g \2V |}#2#2%)C/~b�A�2e�e�� t�:�C�:��O4s:<!$>+V�C"V&Cb�$4R3�"HM:B� :<�MCUtP4R!$4A% �,')4ACU�"��#��)C7:�\M#,'&�.�"H;4 3K#2#,� !$#&( �2CA�5� �73D:���4sC/:�CU#,=;H;��Cb�$��(A:B�$4A%:<�M:<>�V2C"��C�#�Qv� '):�� �"� M(R:<�"��#��O�+���"H;4 �Gp CU4A� �"4R�M(r4ACA�¨M§)µ��¤£ ¥  GªG­s���)§)�E GªG�� T���H;4A!"4 :�!"4�� ';4sCb�$�+#,����:<�)C"t�4A!"���;i CUV&CU�"4A35C tLH;��(IH �vi���J�4R� :]CU�"#,!"V �+� :-CU=Y4A(R�� )4s%%&#,35:��+� �<:<�)C"t�4A!�� ';4sCb�$�+#,�)C�:�\M#,'&�v��� �BQ #�!T4r8;:<35=;>�4 �<:�\M#,'&�vi�#����;iL�$#G!$4ACU�$:�';!I:<� �$CA�_�')(IH #<Qx�"H;��COt�#,! ��t�:�C (R:�!"!$�+4s%l#�';� :<��# :�>+4�';�)%;4R!]1&(IH):�� �u:<�)% ?h\Y4R>�CU#,�~b�s� e,e<�*� ��H;4RV )!$3K>�VO4ACU�$:<\)>+��CUH)4A%��"H;4 �;4R4s%OQ #�!@%&#,3D:<�����2�;#BtL>�4A%;i�4 �)>+#��$CL#�Qv�+���Q #�!G';�)%&4A!$CU�$:��)%&���;i)� ��H;4RV :<>�CU# 35:,%&47��� �"4R!$4ACU�"���;i�35#&%&4A>�CG#<Q[i,#,:<>�C��;�+� �$4R� �"��#��)C:<�M% =;>�:<�MCh:<35#��)ixH2';3D:<�MC�\M4A�+�;i CR����E¡¢�G�� G­(§����E G�¤¦��Q§¤��µ« ��H;4A!"4xH):�CG\M4A4R� 3 ')(IH]!$4R�)4RtP4A%���� �"4R!$4ACU�G���-3D:,(IH;�+�)47�"!I:<�MCU>�:B�$�+#,� ~�_ �h�GCU���)(R4�"H)4�4A:<!$>�V ��y,CR� ��H;4A!"4�HM: J�4 \M4A4R�lC"4RJ�4A!$:�>�>�:�!"i,4O4 �Y#,!U�IC �]6 ';!$#<�"!I:-Q #�! 6 ';!"# �=Y4A:<�l>�:<�)i�'):�i�4AC��L_�'�Q #�! :�=):<�)4AC"4]:<�)%l6 �;i�>���C"H ���/N�_ � \M4R�bt�4A4R�u6 �;i�>���C"H:<�M% :<=):��;4AC"4G:<�G�P:<!$�;4Ri,�+40_�4R>�>+#,�O�@�;��J�4R!IC"���bV��2:��2')C":�!$:��B: :<35#,�;ix���M%&��:���>�:<� �i�'M:<i�4sC�:B�L�*� �*� �.� �/:��;=;';! �&4r�I(<�� �����%$ :�j�?oHpLNXTLcabLcJSFE=�A1Jom»C�BqHpLMf'&-Hp=sFQd\BQR��H;4 )4R>�%�#<Q �GpqZ #�!�(r#�35=;';�$:B�$�+#,�):<>z>��+�)i�';��Cb�$��(AC HM:�CP4R354R!$i�4s%D�����+�$CP#BtL� !$��i�H �:<�M% :x>�:�!"i,4h�2';3 \Y4R!�#<Q�!"4sCU4s:<!I(IHDi�!$#�';=)CP:<!$#�')�)%5�"H)4GtP#�!$>�% :<!$4@tP#�! � ���;ix#�� �+�A�

Page 15: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ��� �� ��������������� W?�CU')!"J,4RV \2V]?@C$CU#&(r��:B�$�+#,�-#�Q���#�35=;'&�I:B�$�+#,�):<>9pn���;i,';��CU�"��(RC5~ ?@�Pp��K~�6 J�4R�MCG:��)%�/:<!"�U�$';�;4A� �&�A�,��W,��>+��Cb�$4A%x�,�L')�;�+J,4R!ICU�+�"��4ACT(r#,�)%&')(r�"���;i.(r#�')!$C"4AC��+�K(r#,3K=)'&�$:<�"��#��):�>>��+�;i,';��Cb�$��(ACR�[12���)(r4.�$H;4R� �2�"H;47:,(*�"��J2���bVDHM:�C�#��)>+V�i,!"#BtL� ~ G#�!$!����s���<�2�*� �@��i�#,!"#,')C:�(r�"��J2���bV 4r8&��CU�$C7�+� C"4RJ,4R!I:<>9#<�$H;4R! !"4sCU4s:<!I(IH}(R4R� �"!$4AC/:,C/t�4A>+> ����H;4R!$4DH): J�4D\Y4R4A�3D:Bab#,!x:�%;J :��)(r4sC7C"�+�)(R4��$H;4 4s:<!$>+V�CU�+82�"��4ACx:<�)% C"���)(r4 �"H;4O%;: V&C/#<QL�$H;4�?GpqZ�?@�!$4R=Y#�!"�A��NP!$�+4 � V ��t�4�tL��>+>;C ��4R�$(IHx�"H;4L:�%;J :��)(r4sCv�+�K4A:,(IHx#�Q)�$H;4�!"4A>�:<�"4A%K%&��C"(R�+=)>+���;4ACC"4R=):�!$:<�"4R>�V �<:��)% M�):<>�>+V H;#Bt �"H)4RV7H): J,4�\Y4R4A�x\)!"#,';i�H �T�"#�i,4r�$H;4R!T�+�5!$4A(R4R� �TV,4A:�!$CA��T�� ��«¥G���)§)��¡s���H;4/i,4R�;4A!$:<�"��J�4@4A� �"4R!$=;!$��C"4.#����"H;4/>����;i�';��CU�"��(RCPQ !$#�� �hCb�I:<!"�"4A%���� �$H;4/>�:<�"4 ;Q �$�+4sCR�� � \;!$#�')i�H � :<\Y#�'&� :-CU4s:�(IH):<�;i,45�+���$H;4�J2�+4At�#<Q�>+���;i�')��CU�$C7�"#Bt�:<!I%;C.>�:��;i�'M:<i�4,�pn���;i,';��CU�"��(P�"H)4R#�!$��4ACvtP4R!$4��;#Bt 4r8&=Y4A(r�"4A%x�$#0\Y4h3D:B�$H;4R3D:<�"��(R:<>�>�V7=;!$4A(r��C"4P���K�"H;4A�+!%&4sC"(R!"��=&�"��#��O#<Qv>�:<�;i,'):<i,4���~ 124A4/|l�+�;#,i�!I:�% ~b�A�,��W � =)=n�[� �I�AW �9Q #,!h:<� �+� �$4R!$4ACU�"���;i:�(A(r#,';� ��#<Q��$H;40H;��CU�"#,!"V5#�Qn>+���;i�')��CU�"��(RCP:�CPCU4A4R� �"H;!$#�';i,H5�"H;404RV,4AC�#<Qq:x(r#�35=;';�"4R!C$(r��4R� �"��Cb�s� � �h�)%;4R!��"H;4Pi�4A�;4R!I:B�$�+J,4[4R� �"4A!"=)!"��CU4��BCU4AJ�4R!I:<><Q #�!$35:�>��$H;4R#,!"��4AC�#<Q)C"V2� �$:B8tP4R!$4 %&4RJ,4R>�#�=Y4A%�C"')(R(R4AC$CU��J�4A>+VO#BJ�4A!L�"H)4 V�4s:<!ICh:<�M%O�"H;4K�;#<�$�+#,��#<Q %&4A!"��JB:B�$�+#,��#<Q:5CU4A� �"4R�M(r40Q !"#,3 �$H;4.�"H;4A#�!$VDtP:,CPQ #�!$3D:<>���C"4A%����H;4 M4R>�%�:<>�CU#�C$: td�$H;4 !$4bab4s(*�$�+#,��#<Q93D:<�2V�:�>��$4R!$�):B�$�+J,4.�"H;4A#�!$�+4sC �M�+�)(R>+'M%&�+�)i

C"4R3D:<� �"��(L�$H;4R#,!"��4AC0~ f ��>+>�35#�!$4K~U�A�,^��,�"�*�9NP'&�L(r#�')=;>+4s%�tL�+�"H �"H;4GQ #�!$3D:<>Y!"4Uab4A(*�$�+#,�t�:�CT�"H)4@:<\)C"#�!$\;���;i.#<Q�CU4A3D:<� �"��(���%;4A:�C[�+�K�"H)4@CUV2� �$:,(*�$��(P�$H;4R#,!"��4AC��<35#,CU�[�;#<�I:<\;>�V �#<QT�"H)4r�$:K!$#�>�4AC����O�"!I:<�)CUQ #�!$3D:B�"��#��M:<>Yi�4R�)4R!I:B�"��J�4G�"H)4R#�!$��4ACLC"')(IHO:,Chc.N0���H;47�)4R4A%OQ #,!GC"V2�,�I:�(r�"��(7:<�)%�C"4R3D:��,�$��(/Q 4A:B�$';!$4AC7~ �/:B�"wx:<�)% f #2%;#�!x~U�A�,^�W,�"�

t�:�C7��%&4A�,�$�� M4A% :��)%�tL��%;4R>�V�:,(R(R4R=&�$4A%�� ��H)4 �;4A4A%}Q #�!5:�C$C"#2(R��:<�"4s% >�4r8&��(r#,� tP:,C:<>�C"#x:�C$C"';354A%D\;';�P>����"�">�40:<�U�$4R� �"��#���tP:,C[=):���%��"#x:,(*�$'):<>�>+V5\;')�+>�%&���;ix�+�PQ #�!�:<�2V5#<Q�"H)4L�"H;4A#�!$�+4sCv\2V7�"H)4R#�!$4r�$��(A:<>&>��+�)i�';��Cb�$��(ACR�v|}#�! �7#��5=;!$4R=M:<!$�+�;i/%&��(*�$�+#,�):<!$��4ACL~ =M:<! ��"��(r')>�:�!">�V-Q #,!x6 �;i�>���C"HM�.tP4R� � ')�;�;#<�$��(R4A% ��� �$H;4�\):,( � i,!"#,';�)%���pq4r8&��(R#�i,!$:�=;H;4R!ICCU�$:<!"�"4s%}')CU���;i](R#�35=;'&�$4R!IC �v:<i :<���}� ';�+�"4�')�;�;#<�$��(R4A%�����H;4�:�!"4s: H):�C/�)#Bt (R#�354tL�+�"H�: \):<�)ix:<�M%���C 3D:��2���;i 3D:<ab#�!�(r#�� �$!"��\;'&�$�+#,�)C9�$#x>�4r8&��(r#���%&4AC"�+i,� �&CU4A3D:<� �"��(Q 4A:<�"';!$4AC��v:<'&�$#�3D:B�$��(D:��):<>�V&CU��C/#<QL>�:<!$i�4D(r#,!"=Y#�!I: �T:<�)%}4AJ�4R� =M:<!ICU���;i)� 1 �$:<�"��Cb�$���(R:�>@:<=)=;!"# :�(IH;4sC5:<!$4�\M4A�+�;i��$!"��4A%�tL�+�"Hli,!"4s:B��C"')(R(R4AC$C5Q #�!�>���3K�+�"4s% �$:,C �&CDC"')(IH:�Ch�$:�i�i����;iD=):�!U� � #�Q � C"=Y4R4A(IH Q #,!@tP#�!I%;CL���-: (R#�!$=;')CA� ��H;4AC"4/Q 4A4A%]��� �"#�i,!$:�3535:�!\):,CU4s% :<=;=;!$#,:,(IH;4ACA����H 'MC �T�"H)4�CU�$:B�$��CU�"��(R:�>�:��)%}�"H;4�i�!I:<353D:B�$��(A:<>[:<=)=;!"# :�(IH;4sC:<!$4/(r#,3K=)>+4A3K4A� �"���;i54A:�(IHO#<�$H;4R!s�� �¢§¤���3¡ ���q¦6�� l§)­@¦�¦����«­@  ¡s­�� � ·��?h�@t�#,! �,4R!ICL:B�U�$4R35=&�$4A%��$# >�#2#���:B�G�"H;4K=;!$#�\;>�4R3 #<Q[>�:<�)i�'):�i�47:�C@�"HM:B�.#<Q (r#,3 �3 ')�;��(A:B�$�+#,�n� ?@C@:x!$4AC"';>+���&�$H;4RV�>+#2# ��4A%O:B�@:�>+>�:�C"=M4s(*�$C��[C"V � �I:B8 �;CU4A3D:<� �"��(RCL:��)%=;!I:<i,35:<�"��(RC0~ �G:<!I:�C"�+35H):�� �z�A���)�s�r� ��H;4.!$#�>�4@#<QT| #,!">�% �2�;#BtL>�4A%;i�4G:��)% %;#�3D:<����2�;#BtL>�4A%&i,4@��� �):<�"';!I:<>Y>�:��;i�'M:<i�4@';�)%&4A!$CU�$:��)%&���;ix:��)% (R#�353 ';�)��(A:B�"��#�� tP:,C !$4A( �#�i,�;��wR4A%K:<�M% i,�+J,4R�Ki�!$4A:B�9��35=M#,!U�I:<�)(R4��9124RJ,4R!I:<>2�+35=;!$4AC$C"�+J,4PC"V&Cb�$4R3DC9tP4R!$4�\;')�+>+���\;'&�/�$H;4RV #�=Y4R!I:B�$4A% 4R�+�"H;4A!7�+� :O�$#BV-%&#�3D:��+��~ |l���;#�i,!$:,% ~U�A�2e<E��"�G#�!/����:O!$4A:�>\;'&�.:<!"�"� M(r��:<>�>�V �):�!"!$#Bt %&#,3D:<��� ~ 1&(IH):�� � :<�)%�?@\M4A>�C"#�� ~U�A�2e�e<�"�*�L?@%;J :��)(r4sCh���

Page 16: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �������������� ������������������������������ !�

C"V � �I:B8��+� >+���;i,';��CU�"��(RC0tP4R!$4 >�:<!$i�4A>+VO�+i,�;#�!$4A%]\ V �$H;4K!"4sCU4s:<!I(IH�t�#,! �,4R!IC��"#��"H;4A�+!%&4R�"!$�+354R� �s��.�;#BtL>�4A%&i,4.!"4A=;!"4sCU4A� �$:B�$�+#,�O:��)% ���&Q 4R!$4R�)(R474R354A!"i,4A% :�Ch:����+35=Y#�!"�$:��,�0:<!$4A:��� ?h��tL�+�"H C"��i��;� M(R:�� �q(r#�� �$!"��\;'&�$�+#,�)C�Q !$#�3�?h��tP#�! ��4A!$Cz��� �@p�Z ~ f ���)%&>�4R! �&�A�2eB�,�r�f �+!ICU��#�!I%&4A! >�#�i���( �2C"4R3D:<� �"��(L�;4R�$C�� Q !$:�3K4sC � 4r�I(<�9=;>�: V5:<����35=M#,!U�I:<� ��!$#�>�4 ~ 1&#BtP: �

�A�,�,�,�*� ��H)4AC"4h(R:<�5\Y4hJ2�+4At�4s%K\ V �"H;4@>+���;i�')��CU��:�C9�"H;4hi,4R�;4A!$:�>+��wA:<�"��#��x#<Qz�"H;4L��%&4s:#<Q9C"�+35=;>�4/CU4A35:�� �"��(0Q 4A:B�$';!$4ACA�vS@#Bt�4AJ�4A!�� �"H)4RV HM: J�403K#,!"4.=Y#Bt�4A!��&�����"H;4 C"4R�MCU4���"HM:B�K(R#��)CU�"!I:<��� �$Cx(R:<� \Y4O4r8&=;!$4AC$CU4s% ��� �$H;4AC"4 tLH;��(IH (A:<�;�;#��x\Y4 4R82=)!"4sC"C"4A% :,CC"4R3D:<� �"��(GQ 4A:<�"';!$4ACL:�>+#,�;4��

pn#,i���(�=;!$#�i,!$:�353K���;i H):�CK4R354A!"i,4A% :,CD:<� �+35=Y#�!"�$:<� ��:<!$4A:)� � �$C5��� � ')4R�)(R4=):�!U�$��(R';>�:�!">�VG�"H;4��;#<�$�+#,�7#<Q;';�)�� M(A:B�$�+#,� �B��C�4RJ2��%&4R� �T#��/�$H;4�(R#�35=;'&�I:B�"��#��M:<> i�!I:<3 �3D:<!IC�#<Q��"H;4D�s����y,CR� cµ������E¦S¦��E T��¥G�;�«­@� �E  ª�¡sµ���¬G��¦�­W���c0!I:<353D:<!vQ #�!$3D:<>���C"3DCv=):<!"�"��(r')>�:�!">�VK��H;#,35C �2V H;��4R!I:<!I(IH2V/tLH;��(IHKt�:�C %&4RJ,4R>�#�=Y4A%�����$H;4/4A:�!">�VDV�4s:<!ICP#<Qq�$H;4/i�4A�;4R!I:B�$�+J,4G4A� �"4R!$=;!$��C"4GQ #�';�)%Oi,!"4s:B��')CU4/��� (r#�35=;';�"4R!C$(r��4R�)(R4K��� :<��';�):�� �"��(r��=):B�$4A%}:<!$4A:��.��� >�:<�)i�'):�i�45(r#�35=;��>�4R!IC0Q #�!/=;!$#�i,!$:�3K35���;i>�:<�;i,'):<i,4AC ~�tLH;��(IH :�!"4 �"!I:<�)C">�:<�"#,!$Cx#<QGC"#�!"�$C Q !$#�3 : H;�+i,H�� >+4AJ�4R>P=;!$#�i,!$:�3K35���;i>�:<�;i,'):<i,47�"# 3D:�(IH)�+�;4K>�:<�;i,'):<i,4s�*� ��H;4K�"H;4A#�!$V�#<Q H)�+4A!$:�!$(IH2V #<QPi�!I:<353D:<!GQ #�! �3D:<>���C"3DCTtP:,CTCU�"'M%&�+4s%x:��)%x!"4 )�;4A%n�v12=Y4A(R��:�>;(R:,CU4sCq#�QY(r#,� �"4r82�vQ !$4R4Pi�!I:<353D:<!�Q #�! �3D:<>���C"3 t�4A!"47%&��C$(r#BJ�4A!"4s%OtLH;��(IH�tP4R!$4/��3K=Y#�!"�$:�� �h�"#�=)!"#,i�!I:<3535�+�;i5>�:<�;i,'):<i,4ACA�NP'&� =Y4R!$H):<=MC ���"H;4�:�%&JB:<�M(r4D35#,CU� ��3K=Y#�!"�$:�� �7�"# �GpqZ ��C/�$H;4 %&4AJ�4R>�#�=)3K4A� �7#<Q=):�!$C"�+�)iK:�>+i,#�!$���$H;3DCR�

Z9:<!IC"�+�;i :�>+i,#�!$���$H;3 ~�#�!�: =):<!ICU4A!�\):,CU4s%�#��l�+�I�5�I:��,4AC : i�!I:<353D:<!�:<�M%l:C"4R� �"4A�)(r4]:��)%�:<�)C"t�4A!$CK�$H;4]� ';4ACU�"��#���tLH;4R�"H;4A!��$H;4]CU4A� �"4R�M(r4](R:���\M4-%;4R!$�+J,4A%Q !$#�3 �$H;4�i�!I:<353D:<!s�n� Q)�$H;4h:<�)C"tP4R!T��CvV,4AC��B')CU'M:<>�>+V��<��� :�>�C"#.CUH;#BthCq�"H)4h%&4R!$�+JB:<�"��#��#�!h�"H;47=M:<!ICU4.�$!"4A4���Z9:<!ICU���;iD:<>�i�#,!"�+�"H;3DC�H): J,4/\M4A4R� �$H;#�!$#�';i,H;>�V !$4AC"4A:<!I(IH;4s%�Q #,!!$4Ri�')>�:�!K:��)% (R#�� �"4R82�KQ !$4R4 i,!$:�3K3D:�!$CA� 124AJ�4R!I:<>P!$4AC"';>��ICD:<!$4 �2�;#BtL� Q #�!D#��"H;4A!(r>�:�C$C"4AC�#�Q/>�:��;i�'):�i�4sC�:�C t�4A>+> ��? (r#��MCU4s�,')4R�)(R4]#<Q7:<>�>G�"H;��C ��C �"H):<��\;';��>�%&�+�)iC"V � �I:�(*�$��(5=M:<!ICU4A!$C0Q #,!7JB:<!$�+#,')C.#�>�%�#�!7�)4Rt =;!"#,=M# CU4s%}i�!I:<353D:<!.Q #�!$3D:<>���C"3DC.��C�;#5>�#��;i,4R!h:5%&� �D(R';>+�L�$:�C �z�

� §¤� ­W�v�qªq�E�E G¡ ­@� �� �¡ µ«�D¬G¥ §)­W� �¤¡ ��­W G¡ ­X@�"H)4R!h:�%;J :��)(r4sC��+��(R#�35=;'&�$4R!@C$(r��4R�)(R4.tLH;��(IH H): J,4G3D:,%&4 �@p�Z =Y#,C$C"�+\;>�4.�"#&%;: V:<!$4@\)�+i,i�4R!P:<�)%�Q�:�CU�"4A!P(R#�35=;'&�$4R!IC �2:<�)%��"H;4.%&4AJ�4R>�#�=)3K4A� ��#<Qq%):B�$:�\):�C"4h�$4A(IH;�)#�> �#�i,V��

� Q@tP4O(R#�35=):�!"4��"H;4 C"�+wA4O#�Q@3D:<��� 354R35#,!"V #�Qh�"H;4 )!ICU�5%&��i��+�$:�>L(r#�35=;';�"4R!~�6 �h�b?@���.���l�A���,^OtL�+�"H��"#&%;: V&C7C"3D:<>�>+4sCb�7=Y4R!IC"#��):�> (r#,3K=)'&�"4A!�~�Z����G�"H):<� #��)4(R:���\;';V ��tP4 )�)%l:���:�>+35# Cb��H2';�)%;!"4s% �$�+354sC����)(r!$4A:,CU4,�d6 �@�b?@� H):,%�:}Q 4Rt�"H)#�')C$:<�)%u\ V �$4AC�#�Q7354R35#�!$V tLH)4R!$4A:�C��"H;4}ZP�{H):,C�^��,y � y�y,y}\ V �$4ACD�$# : Q 4Rt35�+>�>��+#,�D\ V �$4ACA��~ ?u\2V �"4@(A:<�5!$#�';i,H;>+VKCb�$#�!$4@:/(IH):�!$:,(*�"4A!A�F�/p�:<!$i�4R![(R#�35354R!I(r��:<>�>+V: JB:<��>�:�\;>�4x(r#,35=;'&�"4A!$C0H): J,47�$4R� �"# H2';�)%&!$4A%]�"��3K4sC.35#�!$4 354R35#�!$V �"HM:<� :OZP�G�

Page 17: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ��� �� ��������������� ���H;4PC":�3K4�Cb�$#�!$VGH;#,>�%)CnQ #,!�C"=M4A4A%/#�Q;#�=Y4R!I:B�"��#��MCn=Y4R!"Q #�!$3K4s%.\2VG�$H;4�(R#�35=;'&�$4R!�~ #,!�+�$C0�PZ�� #�!0(r4A�,�$!$:�>n=;!$#&(r4AC$C"�+�;iD')�;���*�*�hNP4AC"��%&4ACh�"H;4x35:��+��354A3K#,!"V�354R� �"��#��;4s%:<\Y#BJ�4��93 ')(IH >�:�!"i,4R!x:�35#�';� �x#�QGCU�"#�!I:<i,4���Cx: JB:<��>�:<\;>�4 #,� %&��C �u~ �bV =)��(A:<>�>+V E<y,y35�+>�>��+#,���$#DCU4AJ�4R!I:<>Y�$H;#�')C$:<�M% 35��>+>��+#,� \ V �$4ACI�*���# H):�!"�)4AC$C �$H;��C5=M#BtP4R! �[3D:Bab#,!KC"#<Q �bt�:<!$4�C"V&Cb�$4R3DC5H): J�4�\M4A4R��%&4RJ,4R>�#�=Y4A%��

��H;4AV :�C$C"��CU�5�"H;4]'MCU4A!D�+�ltL!$���$�+�)i�(R#�35=;'&�$4R!�=)!"#,i�!I:<3DC ~�C"')(IHl:�C5=):�!$C"4R!IC$�x#,!=;!$4R=):�!"���;i.�$H;4G%;:<�$:D~ CU')(IH�:�C9i,!$:�3K3D:�!$C[:��)%5>�4r8&��(R#��D!$4R>�:B�$4A%5%;:B�I:,�r� ��H)4h35#,CU���3K=Y#�!"�$:�� �L:�35#��;iK�"H)4R3�:�!"4.H;��i�H � >�4RJ,4R>z>�:��;i�'M:<i�4sC�:<�)%�#�=Y4R!I:B�$�+�;iDC"V&Cb�$4R3DCR�G4RJ�4A>+#,=;354R� �.#<Q�%;:<�$:�\):�C"4KC"V&Cb�$4R3DC.:<>�>+#BthCG4A:,CUV]CU�"#,!$:�i�47#,�}:��)%]!$4r�$!"��4RJB:�>

Q !$#�3 %&��C �D#�Qq>�:<!$i�4G%;��(r�"��#��):�!"��4AC��,>�4r8&��(r#,�)C �2>�4r8&��(R:<>���CU4s%�i�!I:<353D:<!IC��,:<�M% (r#,!"=Y#�!I:#<QT�"4R82�A�

¯&�G­��)£M� �3��µ«�)���_]:�� V�#�Q �$H;4�:<\Y#BJ�4K354R� �"��#��;4s% :,%&JB:<�)(R4AC.:�(R!"# C"C0%&��C"(R�+=)>+���;4AC.tP4R!$4K�+� �"4Ai�!I:B�$4A%���5�"H;47�s���,y�CA� ��H;��C9t�:�C[%&')4L�"#/�$H;4LQ�:,(*�[�$H):B� =Y4R#,=;>�4LQ !"#,3�%&� �z4R!$4R� ��%&��C"(R�+=)>+���;4ACtP4R!$4 tP#�! � ���;i �"#�i,4r�$H;4R!s�7?h>�>v�"H;��C0>+4s%]�$# �$H;4KQ #�!$3D:B�"��#��-#<QP: �;4Rt )4R>�%-(A:<>�>+4s%� ��� � �Q} �}�{���� ��� {~� ���Q{ ��}�{���� #�!�� �}��Q� ��� �� ��� � ���6�´�)� �*�´��{~� � � ��H;4/�"4A35=M#�#<Q!$4AC"4A:<!I(IH]���-�$H;��C.�;4Rt )4R>�%-HM:�C.� ';��( �,4R�;4s%�� ��H)4K��� � ')4R�)(R4K#�Q �$H;4D: J :��+>�:<\)�+>����bV#<Q9=Y#Bt�4A!UQ ')>q(r#,3K=)'&�"4A!@CUV&CU�"4A35CG:B�h>�#Bt (r#,CU�h��Ch3D:<! ��4s%&>+V 4RJ2��%;4R� �@��� �"H;474s:<!$>+V�A�,��y,CR���H;4}�A�,��y�CKC$: t �"H;4 \;��!"�"H #�!53D:B�"')!"���;i}#<Q0C"4RJ,4R!I:<>Pi�!I:<353D:<!xQ #�!$3D:<>���C"3DC

tLH;��(IHK:�!"4�=):�!U�$��(R';>�:<!$>+V7C"';�+�"4A% Q #�![(R#�35=;'&�I:B�$�+#,�x#�QY6[�)i�>���C"Hx#,!v#<�"H)4R![(r#,�� )i,';!$: ��"��#��M:<>&>�:<�;i,'):<i,4ACP~ !$4R>�:B�"��J�4A>+V ;8&4A%xt�#,!$% #�!I%&4R!v>�:<�;i,'):<i,4s�*�T_]:Bab#,!9:<35#��;i0�$H;4R3:<!$4 pn4r8&��(R:�> f ';�)(*�$�+#,�):<>@c0!I:<353D:<! ~�p f c/�K\2V �/:<=)>�:�� :<�)% NP!"4sCU�M:<�d~U�A��� E�� �c04R�)4R!I:<>��+wA4A%�Z H;!$:,CU401 �"!$')(*�$';!$40c0!I:<353D:<!.~ c.Z�1)c/�[\2V�c.:<ws%;:<!P4r�s�v:�> �L~U�A��� ��� ���!"4A4K?G% ab#����;���;i]c0!$:�3K3D:�!K~ ��?hc/�G\2V # CUH)��~U�A�,�,��� �z4r�$(��xNP4A(A:<')C"4K#<Q[�$H;45�+���� ';4A�)(r4x#<Q[>�#�i,��(/=)!"#,i�!I:<3535�+�;i �)';�)�� M(A:B�$�+#,�]H):�CG\Y4A(r#,354x:D\):,CU��(7#,=M4A!$:<�"��#������C"#�354.#<QT�"H;4sCU4.i�!I:<353D:<!PQ #,!"3D:<>���CU3DCA�

12��35�+>�:<!$>+V�� �2�;#BtL>�4A%;i�4D!$4R=;!$4AC"4R� �$:<�"��#���H):,C/H):�%�3D:<ab#�!7��35=):�(r�x#�� �M:B�"')!$:�>>�:<�;i,'):<i,4�C"4R3D:<� �"��(RCT:<�M%7J2��(R4�J�4R!IC$:L�+�x�"H)4G�s����y,CR��?h�2V7(r#,3K=)'&�$:<�"��#��):�> >����;i�';��CU�tP#�! � ���;i�#�� C"4R3D:��,�$��(ACG�"#&%;: V Q !$4R4R>�V-%&!I: thCG';=M#,� >�#�i,��(K:<�M%]#<�$H;4R! �2�;#BtL>�4A%&i,4!$4R=;!$4AC"4R� �$:<�"��#��KC"(IH;4A354ACA�v12��35�+>�:<!$>�V ��!$4AC"4A:�!$(IH)4R!ICqtP#�! �2�+�;i0#����2�;#BtL>�4A%&i,4�!$4R=)!"4�C"4R� �$:<�"��#�� =;!$#�\;>�4R3DCLH): J,4.\M4A4R�-%&4A4R=;>�V ��� � ')4R�)(R4A% \2V �$H;47=Y4R!ICU=Y4A(r�"��J�4sCL#<Qv�"H)4>�:<�;i,'):<i,4��

�����$H;4K(A:�C"47#<Q[���M%&��:����"!I:�%;���$�+#,�):<>T>+���;i,';��CU�"��(RCK~�Z9:��;���;��:��]:<�)%]#<�"H)4R!0i�!I:<3 �3D:<! Q #,!"3D:<>���CU3��O:<�)% >�#�i���(�~ �): J2V : � � V : V,: � ���"H)4RV :�!"4}\Y4Ri����;�;���;i��$# HM: J�4�:3D:Bab#,!x��35=):�(r�5#,� H;#Bt{���)%&��:<� >�:<�)i�'):�i�4ACxCUH)#�';>�% \Y4 H):<�)%;>+4s% (R#�35=;'&�I:B�"��#�� �:<>�>�V ~ N�HM:<!I:B�"��4r�5:<> � ~b�s����y � ��~b�s����y�\M� ��~b�s���,W�:,� �T:��)% 1&:��;i,:�> :<�M% ��H):<�+�$:��2V,:~b�s���2e<�U�r����H;4x!$4AC"';>+�$CG3D: V�i�# \Y4RV,#��)%]���)%&��:<�->�:<�)i�'):�i�4ACG:<�)% :<=;=)>+V �$#�#��"H;4A!�;#,��� (R#��� Mi�';!I:B�$�+#,�):<>�>�:<�;i,'):<i,4AC5�����"H;4 M!$CU���+�MCb�I:<�)(R4�� ��H;4RV 35�+i,H,� :�>�C"# \Y4:<=)=;>+��(R:�\;>�4G�$#�:<>�>�>�:��;i�'M:<i�4sCR�

f �+�M:<>�>+V��;�"H)4R!$4/��CG:<>�CU#�:DC"';\&�$>+4x�+� � ';4R�)(R47#�� tP#�! �2�+�;i5354r�$H;#&%;C��MtLH;��(IH]:<= �

Page 18: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

^ �������������� ������������������������������ !�

=Y4A:<!ICLtLH;4A� �;4Rt �"#2#,>�Ch:�!"4/'MCU4s%���p�:<!$i�4.�2';3 \Y4R!h#�Q9>+���;i�')��CU�$C��$#&%;: V�:�!"4.')C"�+�)i(r#,35=;'&�"4A!$C.���}=;!"4A=):<!$���;iOC"4R� �$4R�)(R45(R#�!$=M#,!$: �z4R>�4A(*�$!"#,�;��(x%&��(*�$�+#,�):<!$��4AC.:<�)% >�4r8&���(r#,�)C��n�+�}tL!$���$�+�;i�C$(IH;#�>�:<!$>�VO=M:<=Y4R!ICG'MCU���;i t�#,!$%-=;!$#2(R4AC$CU#,!$C��z�+��%&#,�+�;i :<�M:<>�V2C"��C#<Qv(r#,�)(r#,!$%;:��)(r4sC � �����$4ACU�"���;iK�"H;4A�+!Li,!$:�3535:<�"��(R:�>M�$H;4R#,!"��4ACP#,�O:5(r#,!"=Y#�!I:7#�QvC"4R� ��"4A�)(r4sC �&:��)%�C"#7#��n�9S@4R!$4h�"H)4G(r#,35=;'&�"4A!���C�#��;>�VK:7�"#2#�>YH;4A>+=;���;i �"H;4A3 %&# \Y4r�"�"4R!#�!�4A:,CU��4R!ntLHM:B�n�$H;4RV.tP4R!$4[%&#����;ih4s:<!$>+��4R!s�qNP'&�q�+�$CTCU')\&�">�4 ��� � ';4A�)(r4sCnH): J,4 :<>�!$4A:�%;V\Y4Ri�')���$#D:<=;=Y4A:�!A�

� ������� � _ LcJ�� BEd�� ]kLca�=

?h>+�"H)#�';i,H ��3K=)!"4sC"C"�+J,4[i,:��+�MCqH): J,4[\Y4R4R�x3D:�%&4P�+�xCUV2� �$:<8 �s�$H;4P:�!"4s:�Cq#<QMC"4R3D:<� �$��(AC:<�M%-=;!I:<i,3D:B�"��(RCGH): J,4 #��)>+V]\Y4R4A�}C$(r!I:B�I(IH;4A%-:�C0V�4R�A�K1&4R3D:<� �"��(K�+� �$4R!$=;!"4R�$:<�"��#����� J,#�>�J�4sC %&4R�"4R!$35�+�M:B�"��#�� :<�)% !"4A=;!$4AC"4R� �$:<�"��#�� #<QG3K4s:<�;���;iM� 12#�354 ��C$CU';4sCx�"H):<�H): J,4 �$# \M4�:�%)%&!"4sC"C"4A% :<!$4��O��%&4R� �"�+Q V2�+�)i��"H;4�354A:��;���;i�#<Q0:}tP#�!I% #,!D: tP#�!I%C"4R�)C"4 �z%&4r�$4R!$35�+�;���;i C$(r#,=M4sCh#�Q9� '):�� �"� )4R!IC � )�)%&���;i�!"4RQ 4R!$4R� �$C@#<Q[:<�):�=;H;#,!$:�~��+���(r>�')%&���;i�=;!$#��;#,';�)C�� !$4 � 4R8&�+J,4AC�� :<�)% %&4 )�;�+�"4�!$4rQ 4R!$4R�M(r4O4r8&=;!$4AC$CU��#��)CI� � !"4A>�:<�"��#��#<Q�35#&%&�� M4R!IC.�"# �;#,';�)C�~��+���$H;4D3D:<�;�;4A! :O35#2%;�� )4A!735#&%&�� M4AC7: �;#,';� ��4�� i)�����(R:,Cb�.��!"#,�]=;';35=}J2CA�/���-t�:B�"4A!G=)';35=M� �q:��)%]��%&4A�,�$��Q V2���;i 354A:<�)�+�;i�#<Q[�$4R�)C"4ACG�$#�"4A35=M#,!$:�>�#�\&ab4s(*�$CA���H;4 :�\M#BJ,49!$:���C"4 %&� ��(r';>+��=)!"#,\;>+4A3DCn#<Q&!$4R=;!$4AC"4R� �I:B�"��#��/:��)%.�+�;Q 4R!$4R�)(R4�� f ��!ICb� �

#�!I%&4A![>+#,i���(/~ f X0p��9#,! �2�;#BtL>�4A%&i,4L!"4A=;!"4sCU4A� �$:B�$�+#,�DCUV&CU�"4R3DC #<Q�4A� ';��JB:<>�4R� � =Y#Bt�4A!H): J,4G%&� ��(r';>+�bVD�+��!"4A=;!$4AC"4R� �"���;ixC"#�354G#<Qn�$H;40:�\M#BJ,4x~�4�� i)� �,�$�+354.:<�)% 35#2%):<>����bV;�*�gL4A=;!"4sCU4A� �"���;i :<�)%u�+�&Q 4A!"!$���;i t�#,!">�% �2�;#BtL>�4A%&i,4 ��=):<!"�"��(r')>�:�!">�V (R#�3535#��uC"4R�)C"4�2�;#BtL>�4A%&i,4 �s��C�%&� ��(R';>��s�T?@i,:��+� � f X0pDH):�Cq%&� ��(R';>��bV.��� %&4s:<>��+�;i@tL���$H/i�4R�)4R!I:<>��+wA4A%� '):<� �$�� )4A!$CL:��)%�4r8;(r4A=&�"��#��)C/~�4�� i)� �;35#,CU�L\;�+!I%;C � V;�r���H;4�:<\Y#BJ�4 =;!$#�\)>+4A35C5HM: J�4O�"#�\Y4 Q�:�(r4s% tLH;4r�$H;4R!�#,�;4 ��C %&4A:�>+���;i�tL���$Hl:

C"�+�;i,>+4/C"4R� �"4A�)(r4.#,!h%&��C$(r#,';!ICU4,�91&#�354.t�#,! �DH):,C�\M4A4R��%&#,�;4/#����"H;47CU�"!$')(r�"';!$4.#<Q%&��C"(R#�';!IC"4��L124R3D:<� �$��(ACh#<Q[%&��C$(r#�')!$C"47CU4Ai�354R� �ICh��C@:DH):�!$%;4R!h=;!$#�\)>+4A3O���$pn�+�"4R!I:<>C"4R3D:<� �"��(RCv#�QzC"���;i�>�4hCU4A� �"4R�M(r4AC (R:<�K\Y4h')C"4A%x�"#/��%&4R� �$��Q Vx�"H;4h%;��C$(r#,';!$C"4LCU4Ai�354R� �IC:<�M% �&';>+�"��35:<�"4A>+V��;�"H)4R��!hCU4A35:�� �"��(RCA�

|lH;4A� #��)4�(r#,354ACq�"#@=)!$:�i�3D:B�$��(AC � 4RJ,4R�/�$H;4P��C$CU')4ACT:<!$4[Q ';wAwRV�� ��H;4�'&�U�$4R!I:<�)(R4';�)%;4R! (R#��)C"��%;4R!I:B�"��#�� �qtLH;4R�"H;4A! :�CU4A� �"4R�M(r4D#�!x:�%&��C$(r#,';!ICU4DC"4Ri�354A�,� �TC"4R!$J�4sC.:(r#,353 ';�;��(R:<�"��#���=)';!"=Y#,C"4��9?�C"�+35=;>�40%;4A(r>�:<!I:B�$�+J,4GC"4R� �"4A�)(r40Cb�I:B�$�+�;i5: Q�:�(*�/~ 4,� iM� ��+� ��C[!$:��+�;���;i2�q��C[�)#<��ab')CU��:/CU�$:B�$4R354R� �[#�QMQ�:,(*��� \;'&�PCU4A!"J,4ACvCU#,354h(r#�353x';�;��(R:B�$�+J,4Q ';�)(r�"��#���~ 4,� iM� � �"#K���&Q #�!$3 �2�"#K3K��C">+4s:�% :�\M#,'&�PQ�:�(*� �2�"#K35��C">+4s:�%�:<\Y#�'&�LCU=Y4A:���4A!�� C\Y4R>��+4RQ�:�\M#,'&�[Q�:,(*�����"# %;!$: t :B�U�$4R� �"��#��K�$# :<>�!"4s:�%&V � �)#BtL�xQ�:,(*� �<�"# !"4A3K���)%5:<\Y#�';�:G=;!"4AJ2�+#,')CU>�V/354R� �"��#��)4A%x4RJ�4A� �T#,!T#,\&ab4A(r�9!"4A>�:<�"4A%7�"#0Q�:�(r���<4R�$(�� �r�v?GC9(R:�� \Y4�C"4R4A�Q !$#�3��"H)404R8;:<35=;>�4 �2�"H)40=)!$:�i�3D:B�$��(@�+� �"4A!"=)!"4R�$:B�$�+#,��:�=;=M4s:<!IC[�$#5\M4.#�=Y4R�O4R�M%&4A%����H;��C[(r#,';>�% #�Qz(R#�';!ICU4P\Y4h:.!"4 � 4A(r�"��#��K#<Qz#�';!v��i��;#,!$:��)(r4,�T12=Y4R4s(IH5:,(*�v�"H)4R#�!$V :��)%1&(IH):�� � � C�tP#�! �5:�!"4G=M# C"C"��\;>+4.:<=)=;!"# :�(IH;4sCR�v124R47��H;��4R!I(IH;��: :<�M% _]( ��#��;4A>+> ��c0���;4R�~b�s���)�s�[Q #�!L35#�!$4/%&4r�I:<��>�CA�

Page 19: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �� ��� ���� � �� e���� #� �8. � �8#����� :<>�>[�$H;4�:�=;=;>���(A:B�$�+#,�)C/#<Q �GpqZ 354R� �$�+#,�;4A%���� �"H)4�>�:,Cb�KCU4s(*�"��#�� �T>�:<�)i�'):�i�45��CC"4R!$J ���;iK:K(R#�353 ')�;��(A:B�$�+J,4hQ ';�)(r�"��#��n� f #�!L4R8&:�35=;>+4��2�+�O�):B�$';!I:<>z>�:��;i�'M:<i�4G�+� �$4R! �Q�:�(R4ACP�$#�%;:B�I:<\):,CU4sC �&')C"4R!ICL(r#,353 ';�;��(R:<�"40�"H)4R��!h�+�;Q #�!$35:<�"��#��O�;4R4s%O\ V�354A:<�MC�#<Q�):<�"';!I:<>T>�:��;i�'M:<i�4K� ';4R!$V��.���]�$H;4D(r#,�,�$4r82�G#�Q 3D:�(IH;���;4x�"!I:<�)C">�:B�"��#�� �)�$H;45tL!"�+�"4A!t�:<� �$Cv�$#x(R#��2J�4AV CU#,354r�"H)�+�;i7�"#7H;��C�!"4s:�%&4A!$CT�$H;!"#,';i�H5�$4r82�A� ��H;��C[��C[�)#<��C"';!$=;!"��C ����;i5\M4s(R:<'MCU4.�$H;4/=;!$�+3D:<!$V5Q ';�)(r�"��#�� #<Qv�):<�"';!I:<>z>�:<�;i,'):<i,4G��Ch(r#,353 ';�;��(R:<�"��#��n�

? (r#��MCU4s�,')4R�)(R4 #<Q��"H;45:<\Y#BJ�4x��CG�$H):B� �@p�ZuQ #&(R')C"C"4ACG#��-�"H;4DCU�"')%;V�#<Q�>�:<� �i�'M:<i�40:�C�:x3K4s:<�)CP#�QT(r#,353 ';�;��(R:<�"��#��n�v|lH;4A�O:KC"=M4s:���4A!0~�#�!L:xtL!"�+�"4A!I� �+� �$4R�)% ����;i7�$#x(r#,353 ';�;��(R:<�"4@C"#�354R�"H;���;i/�$#x:7H)4A:<!$4R!G~ #�!�!"4s:�%&4A!I�9'&�U�$4R!IC #,! tL!$���$4AC�� :��)%�"H)4xH;4s:<!$4R! ~�#�!0!"4s:�%&4A!I�L#��]!$4A(R4R��J ���;iD�$H;4K'&�U�$4R!I:<�)(R47#�!G�"4R8 �0i�4R�$C@�"H):<� �"C"#�354��"H)�+�;i �q(R#�353 ')�;��(A:B�$�+#,�-H):,C@�I:��,4R�-=)>�:,(r4��DX@QP(R#�';!ICU4��z�"H;4D(R#�353 ';�)��(A:B�"��#�� ��CC"4R>�%&#�3 =Y4R!"Q 4A(r���qtLHM:B�0�"H;45H;4s:<!$4R!0!"4s(r4R��J�4sCh��C/:<�}:<=;=;!$# 8&�+3D:<�"��#���#<Q�tLH):B�.�"H)4C"=M4s:���4A!@t�:<� �$Ch�"#O(r#��2J,4RV��0NP'&�G')C"'):�>+>�V ���.��C0:�!$4R3D:�! �B:<\)>+VOi�#2#&%�:<=;=)!"# 8&��35: ��"��#��q�x?h>�C"# ���$H;4D(r#�353x';�;��(R:B�$�+#,�-!$4A� ';��!"4sC0�;#<�.#��;>�V-:O(r#,3K35#,�->�:<�;i,'):<i,4 \;'&�:<>�C"#7CUH):�!"4s% �2�;#BtL>�4A%;i�4L:<\Y#�'&� �"H;4@%;#�3D:<���5�+��� ';4sCb�$�+#,�n� �@4RJ,4R!"�"H;4A>+4sC"C[(R#�353 ' ��;��(R:<�"��#����$:��,4AC�=;>�:�(R4����H;4/:<\Y#BJ�4@�"!I:<�)CUQ 4R!L(A:<�O\M4.>�# # ��4s% :B��Q !$#�3��$H;4.=M#,�+� �h#<Q�J ��4Rt #<QT�+�&Q #,!"3D: �

�"��#��q� ��H)4GC"=M4s:���4A! t�:<� �$C[�"# (R#��2J�4AVKC"#�354h���&Q #,!"3D:B�$�+#,�5�"# �"H;4GH;4A:�!"4A!A�vS@: J2���;i%&4s(r��%&4A%5#,�x�$H;4h���&Q #�!$3D:B�$�+#,�KH)4LtP:��,�ICv�"#7(R#��2J�4AV �<H)4h3 ')CU� %&4s(r��%&4hH;#Bt �"#7(R#2%;4�+�����O>�:��;i�'):�i�4,�T�h�U�"4A!$:��)(r40��CP�"H;4.#��)>+V5�$H;�+�)i5:,(*�$'):<>�>+VD!$4A(R4R��J�4s%D\2V5�"H;4.H;4s:<!$4R! �')C"�+�)iOtLH)��(IH}H;45i�4R�$C0�"H)4K���&Q #,!"3D:B�$�+#,�n�K� �/Q #�>�>+#BthC��z�"H;4A!"4RQ #�!$4 ���$H):B�.�$H;4D�+�;Q #�! �3D:B�$�+#,� ��CD(r#�� �I:<���;4A% ��� �"H;4 '&�"�"4R!I:<�M(r4 ��:<�)% �"H;4 H;4s:<!$4R!K3 ')CU�D4r82�"!I:�(r�K�+�K\2V%&4s(r#&%&���;i5���s���H;4�:<\Y#BJ�4�J ��4Rt ��CT�;#,��� (R#�� �"!$#BJ�4A!$C"��:<><���7�$H;4L(R:�C"4 #�QY(R# #,=M4A!$:<�"��J�4P(r#�353x';�;� �

(R:<�"��#��x�+�2J�#,>+J2���;i@���&Q #,!"3D:B�$�+#,� 4R8&(IHM:<�;i,4�:<�M% H):,CT\M4A4R�5:�%&JB:<�M(r4A% �+�x�"H)4�=):,Cb�9���JB:<!$�+#,')C�Q #�!$3DCR�v|lH):<��tP40t�#,';>�%�>�� �,4@�$#5%;#x��CP�"#D(R:�!"!$VK�"H;��C�J2�+4Atu�$#x�$H;4/Cb�$')%&V#<QP>�:��;i�'M:<i�4O~ 4sCU=Y4A(R��:�>+>�V �"# tLH):<�0��C/(R:�>+>�4A% CUV2� �$:<8]#�!/CUV2� �$:,(*�$��(x=;H;4A�;#�354R�M:,�*��[:<!$��#�')C0=;H;4A�;#�354A�):O�+��:O>�:��;i�'):�i�4xtL�+>�>9\M4�:��):<>�V2wR4s%�Q !$#�3 �$H;45J ��4RtL=Y#���� �/#<QH;#Bt �"H;4AV (r#&%&4D���&Q #,!"3D:B�$�+#,�n� ��H2')C ��t�#,!$% #�!I%&4A!.:��)%�(R:,CU454R�M%&�+�)i,C0�"')!"��#�';��"#K\Y47:<>+�"4R!$�):<�"��J�4@t�: V&C #�QT(R#2%;�+�;ix�"H)4.C$:<3540�+�;Q #�!$35:<�"��#��}~ !$4Ri,:�!$%;�+�;iKCU4A3D:<� �"��(!$4R>�:B�"��#��MCUH;��=)C0\Y4r�btP4R4R��:�J�4R!$\ :��)%-�"H;45�;#,';�)C��n4r�I(<�F� |lH;4A� �$H;4DC":�354K%&4AJ2��(R4~ #,!L=;H;4A�;#�354R�)#��M�P���O�"H;4/>�:<�;i,'):<i,4G��CL')C"4A%��$#5(R#&%&4.�bt�#D%&� �z4R!$4R� � �2�+�)%)C�#<Qv�+���Q #�!$3D:B�$�+#,� � �"H;4A!"40��C�:x=M# C"C"��\;�+>��+�bV5�"H):<��:K(r#,� � ��(*�L3D: V5:�!"��C"4��v?hi,:��+� �"H;4/(IH;#,��(R43D:�%&4��+� �"H;4O>�:��;i�'M:<i�45�$#-H):��)%&>�4��$H;4O(R#�� � ��(r�x3 'MCb�K\M4O>+#2# ��4A% :<� Q !$#�3 �"H)4=Y#����,�G#<Q9J2�+4At #�Qv���&Q #,!"3D:B�$�+#,��(r#&%&���;i)� f #,!h4r8;:<35=;>�4 �M�+��(R#�� �"!$#�>ntLH)4R�]:5�;#,';�i�!$#�')=]��C0��� C"4R3D:<� �$��( !"4A>�:<�"��#��]tL�+�"H-�bt�# %&� �Y4A!"4A�,�.J�4A!"\MC �z(R:,CU4x4R�)%&���;i (R:��-\Y4:�C$C"�+i,�;4A%5\2V5#��;>�V5#��;4@#<Q��"H)4@�btP#7J�4A!"\MCR�v? (IH)#���(r4h3x')Cb�P\M403D:�%&4G\2VK>�:<�)i�'):�i�4���KC"')(IHx:Gt�: V.�"H):<�T�$H;4��+�;Q #�!$35:<�"��#��K:<\Y#�'&�9CU4A3D:<� �"��( !$4R>�:B�$�+#,�)Cv(R:�� \Y4�%;4A(r#&%&4s%�"#K�$H;4/4r82�"4A� �h=M# C"C"�+\)>+4,���H;4/���&Q #�!$3D:B�$�+#,�O\M:�C"4A% :<=;=)!"# :�(IHO=;!"#BJ2��%&4AC��M:B�"')!$:�>n(r#��)�;4A(r�"��#��)CL\Y4r�btP4R4A�

tLH):<� :<!$45(A:<>�>+4s%�CUV2� �$:<8 �TCU4A3D:<� �"��(RC/:��)%}=;!$:�i�3D:B�$��(ACR�D����Q�:,(*� ��#,�;4D(R:<��J2��4Rt

Page 20: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �������������� ������������������������������ !�

:<>�>��$H;4AC"47:�C�=;!$#BJ2��%;�+�;iD:x�"H)4R#�!$V�#�Qv(R#�353 ';�)��(A:B�"��#�� �;4A:,(IHO:<�@:K%;���z4R!$4R� �@>�4RJ,4R> �6[J,4R� �"'M:<>�>+V��)�$H;4RV]tP#�')>�%]:�>+>T\Y4K��� �"4Ai�!I:B�"4s% �"#,i�4R�"H;4A!G��� �"#�:�i�4A�;4R!I:<>q�"H;4A#�!$V #<Q(r#,353 ';�;��(R:<�"��#��n� @��J2��C"�+#,� �+� �"#��"H;!$4R4/>�4RJ,4R>�C �2�$H;4R!$4rQ #,!"4��;t�#,';>�%�\Y473D:<���;>�V�%&')4�"# 354r�$H;#&%&#�>�#�i,��(A:<>9!$4A:,CU#,�)CR� �.�;#BtL>�4A%&i,4x!$4R=;!$4AC"4R� �I:B�"��#��}:<�)%}')C"45t�#,';>�% :�>�C"# ;�h�;4s:B�$>+V����O�"H;4.Q !I:<354At�#,! �z�

� �/CUH;#,';>�%]\Y4K354A�,�$�+#,�;4A%]�"H):<�/tLH;4R��: C"=M4s:��,4R!G�"!$�+4sC@�$#�(r#&%&4K�+�&Q #,!"3D:<�"��#��tLH;��(IH5H;4ht�:<� �$CT�$#74r8&=;!$4AC$Cv�+��:.>�:<�)i�'):�i�4 �<(R4R!"�$:��+�5=):�!U�IC9\M4s(r#,3K4h(R';3 \Y4R!IC"#�354�"#/(R#2%;4�� f #�!v4r8;:�3K=)>+4��B�"H;4�i,4R�)%&4A!v#<Q)�$H;4LCU=Y4A:���4A!���Cv�;#<�9(r#&%&4s% ���x�"H;4�=;!$#��;#,';� � �B#�!T�"H;4�J,4R!$\n� ��H2')C�� �"H;4L(R#2%;�+�;i0=;!$#&(r4AC$CvCU#,354r�"��354ACT>�#,C"4ACT�+�;Q #�!$35:<�"��#��n�T6[J,4R����-CU'M(IH-:�C"���$'):B�$�+#,� �)�$H;4 H)4A:<!$4R!G��C@!"#,'&�"���;4A>+V�:<\)>+4/�$#�%&4s(r#&%&4 �"H;4x�+�&Q #,!"3D:<�"��#��\2V7')C"�+�)i0H)��Cv\):,( �2i�!$#�';�)% � �)#BtL>+4s%&i�4,� ��H;4A!"4L:<!$4�CU4AJ�4R!I:<>2C"#�';!I(r4sC�#�Q��2�;#BtL>�4A%&i,4�"HM:B�P:�!"4L'MCU4s%5�+� %;4A(r#&%&���;i/�$H;4@���&Q #,!"3D:B�$�+#,�KQ !"#,3 :��D'&�U�$4R!I:<�)(R4�� ��H;4AC"4@(A:<�D\Y4(r>�:�C$C"�� )4s% ��� �"# �

�,�hpq:<�)i�'):�i�4 �.�)#BtL>+4s%&i�4~�:,�Oc0!I:<353D:<!~ \M�Opn4R8&��(R#��~ (A�OZ[!I:<i,3D:B�"��(RC�:��)%�%;��C$(r#,';!$C"4

4r�$(��E;�hNP:,( �2i�!$#�';�)% � �)#BtL>+4s%&i�4

~�:,�Oc04R�)4R!I:<>�tP#�!$>�% �2�;#BtL>+4s%&i�45~ ���)(R>+')%;�+�;i�(R#�3535#�� CU4A�)C"4 �2�;#BtL>�4A%;i�4s�~ \M��G#�3D:<���}C"=Y4A(r� M( �2�;#BtL>�4A%&i,4O~��+�)(R>+'M%&4AC0�$H;4�CU=Y4A(R��:�>+��wR4s% �2�;#BtL>�4A%&i,4

#<QT�"H)47:<!$4A:K:<\Y#�'&�LtLH;��(IH�(r#�353x';�;��(R:B�$�+#,����CP�$:��2�+�;i5=;>�:�(R4s�~ (A����#�� �$4r82�K~�J�4R!$\):�>T:��)%]�;#,��� J�4R!$\):�>qCU�+�"'M:B�"��#�� �+� tLH;��(IH-(r#,3K3x';�;��(R: �

�"��#�� ��CP�"#5�I:��2�+�)iK=)>�:,(r4s�~�%)����';>+�"';!$4��2�;#BtL>�4A%&i,4

��H2')C��;: H;4s:<!$4R!�(R:���')C"4.:<>�>z�"H;4/C"#�';!I(r4sC #�Q �2�;#BtL>�4A%&i,40:�\M#BJ,4h�"#54R8 �$!$:,(*���+�;Q #�! �3D:B�$�+#,� Q !$#�3 :xi,�+J,4R�O'&�U�$4R!I:<�)(R4��

� �5��Cx�+35=Y#�!"�$:��,�K�"# ��4A4R= ��� 35���)% �$H):B�5�$H;4OC"=Y4A:��,4R!xH):�CK:-35#&%&4A>P#�Qh�"H)4>���CU�"4A�;4R!s� ��H2')C��[�$H;4�CU=Y4A:���4R!5(r#&%&4sCKtLH):B�D���&Q #�!$3D:B�"��#�� H;4 tP:�� �$Cx�"#�(r#,� J,4RV��')C"�+�)i-H;��CK\M4A>+��4rQ�CK:<\Y#�'&�K�"H)4OC"#�';!I(r4sC7#�Q � �)#BtL>+4s%&i�4 : JB:��+>�:<\;>�4D�$#-�$H;4 >���CU�"4A�;4R!:<35#,�;i5#<�"H)4R!��"H)�+�;i C/~�C"')(IH�:�C��&i�# :<>�C �2=;>�:<�)C��)%&4sCU��!$4AC��&=;!"#&(R4AC$CU���;i5(R:<=M:<\;��>+�+�bV�#,!���,�$4R>�>+��i�4A�)(r4x#<Qv�"H)4x>���CU�"4A�;4R!*�*�G? i,# #&%�C"=M4s:��,4R!htL��>+>v(r#&%&4x�+�;Q #�!$35:<�"��#������-C"')(IH:KtP: V��"H):<��H)��CL>���Cb�$4R�;4A!s~ C$��(A:<�O4A:�C"��>+V %;4A(r#&%&4.�+�A�

?@CK:<>�!$4A:�%;V}%&��C$(r')C$CU4s% �v�"H)4OCU�"')%;V #<Q@>�:<�;i,'):<i,4DQ !$#�3 �"H;��C5:�C"=M4s(*�x�"!$�+4sC7�$#>�# # �D:B��J :�!"��#�'MC >�:<�;i,'):<i,4h=;H;4A�;#�354A�):7Q !$#�3 �$H;4.�+�&Q #,!"3D:<�"��#���J2��4RtL=Y#����,�s� ��H;��C��Cx�)#<�5�"# C$: V �$H):B�5�$H;4R!$4O:�!"4O�;#}#<�$H;4R!KQ�:�(r�"#,!$CA� ��H;4 >�:<�;i,'):<i,4�%&#24ACx�$!"V��$#3D:<��� �$:<��� !$4Ri,';>�:<!$���bVD:�(R!"# C"C�(r#,�)Cb�$!"'M(*�"��#��MC Q #,!�4A:�C"40#<Q�:,(R� ';��CU�+�"��#���#<Q�>�:<�)i�'):�i�4:�C�tP4R>�>n:�C�4s:�C"4.#<QT%;4A(r#&%&���;i]~ :<�)%O(r#&%&���;i �r�

Page 21: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �� ��� ���� � �� ���H;4x�;#<�$�+#,�]#<Q i,!$:�3535:�!LQ !$#�3 �"H;4K���&Q #�!$3D:B�"��#��-J ��4RtL=Y#���� �G��C.: C"V2CU�"4A3 #<Q!$';>+4sCn�$H):B�v!$4R>�:B�"4sCq���&Q #,!"3D:B�$�+#,�/�"#0�+�$Cv(r#&%&���;i0�+�x>�:��;i�'):�i�4,�q_�#�!$4R#BJ,4R! �r�$H;4R!$4���CT:

(r#,35=;'&�$:<�"��#��):�>&!"4s� ';�+!$4R354A�,�v�$H):B�9�$H;4Li�!I:<353D:<!9C"H;#�';>�%x\M4@C"')(IHx�"H):<�[��� (A:<�5\Y4')C"4A% \ V5�$H;4.CU=Y4A:���4R!��"#5(r#&%&4G�+�;Q #�!$35:<�"��#����+� �"H;40>�:��;i�'M:<i�40:<�)%�\ V5�$H;4.H;4A:�!"4A!�"#�%&4s(r#&%&45�$H;4D�+�;Q #�!$35:<�"��#��n�5|lH;4A�}�"H;4�C"V&Cb�$4R3 #�Q�!$';>+4sC.!"4A>�:<�"4sC.�+�&Q #,!"3D:<�"��#���"# (R#2%;�+�;i %&4AJ2��(R4AC5:B�5�"H)4�>�:��;i�'):�i�4�>+4AJ�4R>h:��)% �;#<��:B�5�$H;4 t�#,!">�% �2�;#BtL>�4A%&i,4>�4RJ�4A> �q���7��C7(R:�>+>�4A% � �q} �� �DNP'&�7(r>�4A:<!$>�V ���$H;4R!$4D:<!$45CU�"!$#��)i���� � ';4A�)(r4sC/#<QPt�#,!">�%�2�;#BtL>�4A%&i,4/#��O�"H;4x(r#&%&���;i)� f �+!ICU���)�+�@��� � ';4A�)(r4sCL�$H;4/Q ';�)%):<354R� �$:�>�(R#2%;�+�;i�(r#�� �J�4A� �"��#��)C@#<Q[>�:<�;i,'):<i,4�� f #�!@4R8;:<35=;>�4 �Y�+� ���)%&��:<�]>�:<�;i,'):<i,4AC��;�$H;4 =Y#,CU�G=Y#,C"���$�+#,�3D:<! ��4A!5Q #�!��;#,';��i�!$#�';= �$H):B� ��CDi,#,:<>L#,!D�"H)4R354]#�! � :�!"3D:�(R:���\M4-%;!"#,=;=M4s%=;!$4A(R��C"4R>�V�tLH;4A���+�h��Ch�+�):��;��35:<�"4D~ \Y4A(A:<')C"4.�"H)47:<i�4A� �P��CL�;#,!"3D:<>�>�V�:<�;��3D:B�"4/:��)%�"H)4R!$4 ��CG�)#�:<3x\;��i�';�+�bV �+�}%&��CU�"���;i,';��C"H;���;i��"H;45CU4A3D:<� �"��(7!$#�>�4ACI�*�/12��3K��>�:<!0��CG�"H)4(R:,CU4KtLH;4A�-�$H;4DCU4s(r#��M%-=Y4R!ICU#,�-=;!$#��)#�';� ��C/%&!$#�=)=M4s%]Q !$#�3 : (r#,3535:��)%�� ��H;��CH):�=;=M4A�)C/��� :<>�>9>�:��;i�'):�i�4sCG���)(R>+')%;�+�;i]6 �;i�>���CUH �qtLH;��(IH�#��"H;4A!"tL��CU45H):,C/: Cb�$!"#,�;i!$4A� ';��!"4A3K4A� � �"HM:B��CU')\&ab4A(r�K3x')Cb�5\Y4O=)!"4sCU4A�,�s� 124A(R#��)% �[����: �Y4s(*�$Cx�$H;4O(R#&%&�+�)iQ #�!�=):�!U�$��(R';>�:<!�'&�U�$4R!I:<�)(R4ACP')C"4A%�\2V :xC"=Y4A:��,4R!�\Y4A(R:�')C"4GH;4 �2�;#BthC��"HM:B�LH;4.�;4R4s%�;#��@�"!$V��"# 4R8&=;>+��(r�+�">�V�(r#&%&47���&Q #,!"3D:B�$�+#,� �"H):<�G��CG: JB:��+>�:<\;>�4�~ #,!@#,\ J2��#�')CI�P�$#��"H)4H;4s:<!$4R!9Q !$#�3�t�#,!">�% � �)#BtL>+4s%&i�4,� ��H2')C������D�"H)��C J ��4Rt �$H;4R!$4h��C[�;# C"H):�!"=5��CU#,>�:<�"��#��\Y4r�btP4R4R� C"V2�,�I:B8 :��)%�CU4A3D:<� �"��(RCA��gh:B�$H;4R! ���$H;4 C"4R=):�!$:<�"��#��-��C/3D:<���;>�V]\Y4A(R:�')C"4#<Q.=;!I:<i,35:<�"��(O!"4s:�C"#��)C5#�Q04s:�C"4�#<Q.=;!"#&(R4AC$CU���;i�#�!Di,!$:�3K3D:�!DtL!"�+�"���;i)��12V2� �$:B8')C"4ACx>�:��;i�'M:<i�4�(r#&%&���;i}%;4RJ2��(R4ACxtLH;��>+4��"H;4 C"4R3D:<� �"��(RCK:<>�C"#]')C"4ACKt�#,!">�% �2�;#BtL> �4A%;i�4�� ���M%&4R4s% C"#�354 #�Qh�"H;4 ��� �"4R�MCU��J�4A>+V CU�"')%&��4A% =;H;4A�;#�354R�M:-��� C"V2�,�I:B8 C"')(IH:�CL:��):<=)H;#�!I: ~ (r#BJ�4A!"���;ix!"4 � 4r8&��J�40=;!"#,�;#�')�)C�:<�)%�!"4s(r��=;!$#2(A:<>�C$� 3D: VD�"')!"�O#�'&���$#\Y4/#<Qv3K���;#,!h�+35=Y#�!"�$:��)(r4.#��M(r4/�+�h��CL!$4A:�>+��wR4s%��$H):B�L�$H;4/tP#�!$>�% �2�;#BtL>+4s%&i�4.��C��"H)43D:Bab#,![%&4A(R��%&���;i/Q�:,(*�$#�!s�T12V2� �$:,(*�"��(�!$';>+4sC9!$4Ri,:�!$%;�+�;i/:��,�$4A(R4A%&4A�,�[#�Qz:��):<=)H;#�!I:G%;#�;#��GH): J,4.�"H;4 � ���)%�#�Q[�+35=Y#�!"�$:��)(r47i,�+J,4R� �$#��"H)4R3 �+�]�"H;4x!"4s(r4R� �0V�4A:�!$CA����H2')C ����]#�';!0J2�+4At �YC"V2� �$:B8 ��C@�;#��0CU�"')%;�+4s%��"# ��%&4A� �"�+Q V]:<�]���;�):<�"4x:�'&�"#,�;#�35#,')Ch>�4RJ,4R> �\;'&��!I:B�"H)4R![�$# !$4R>�:B�$4@�+� �"#KCU4A3D:<� �"��(RCP:<�)%�t�#,!">�%��2�;#BtL>+4s%&i�4h�"#x:,(R(R#�35=;>���C"HD�"H)4#BJ�4A!$:�>+>M�$:,C �&C�#�Qv(R#�353 ';�)��(A:B�"��#��O#<QT�+�;Q #�!$35:<�"��#��n���H;4.:<\Y#BJ�4h��%&4s:�CP>+4s:�%5�$#K: Q ';�)%):<354R� �$:�>�(IH):<�;i,4h��� �$H;4GJ2��4Rtu#�Qqi�!I:<353D:B� �

��(R:<>��+�bVY��� �0��C � �)#BtL���$H):B�G!"4s:<>q>��+Q 47'&�U�$4R!I:<�)(R4AC��)\Y#<�$H-CU=Y#��,4R��:<�M% tL!"�+�U�$4R� �z:<!$4Q ';>�>9#<QPtLH):B�7:<!$4x(A:<>�>+4s% �"';�;i,!$:�3K3D:<�"��(R:<>�C"4R� �"4A�)(r4sCR� � �.��C.��3K=Y#�!"�$:�� �G�$#O4R8 �=;>�:<�����"H)4R3 \Y4A(R:�')C"4 #<Q�\M#��"H]�$H;4R#,!"4R�"��(R:�>�:<�M%]=;!I:�(r�"��(R:<>�!"4s:�C"#��)CA�@?@� V �$H;4R#,!"VtLH;��(IH (r>�:<��35C/�"#]%&4sC"(R!"��\M4D#,!/4r8&=;>�:<�����):B�$';!$:�>9>�:��;i�'M:<i�4��n3 'MCb�74R82=)>�:��+�}�"H)4AC"4'&�"�"4R!I:<�M(r4AC9:,CTt�4A>+>n~ �@:<!I:�C"��3KHM:<� �&�s���;� �*��� �vtL��>�>;�;#<�9\Y4L:�(R(R4R=&�I:<\;>�4P�"#/C$: V.�"H):<�C"')(IH CU4A�,�$4R�)(R4ACx:<!$4Di�!I:<353D:B�"��(R:�>9�+� (R#�� �"4R82�7\;'&�x')�;i�!I:<353D:B�$��(A:<>9#<�$H;4R!$tL��CU4,���H):<��tP#�';>�%D\Y4@\2V2=):�C$CU���;i/�$H;4G� ';4sCb�$�+#,�n�v� Qn#��;40(r#,�)CU��%&4A!$C[�"H;40(r#�353x';�;��(R:B�$�+J,4:�C"=Y4A(*� ��CU4A�,�$4R�)(R4ACG:<!$4 :<>�tP: V&CL���-(R#�� �"4R8 �s�G? CU4A� �"4R�M(r47��CG(R#��)C"��%&4R!$4A% ���]��CU#,>�: ��"��#��}CU#,>+4A>+VO�$#OC"�+35=;>��+Q V]:<�):�>+V&C"��CK~ #,!Gi,4R�;4A!$:<�"��#��M�r�.? C"4R� �"4A�)(r45:<�):�>+V2wA4R!@3x')CU��;#��T!$';>�4�#,'&�v:GCU4A� �"4R�M(r4�:�C�';�;i�!I:<353D:B�$��(A:<> tLH;4R� �"H;4�C"4R� �"4A�)(r4�(R:��73D:���4�C"4R�)C"4���OC"#�354.(r#�� �$4r82�A� XG���$H;4/(r#,�,�$!$:�!"V����+�L3 ')CU�L=M4A!UQ #,!"3 :���:<�M:<>�V2C"��CG~ : =;>�:<'MCU��\;>�4:<�M:<>�V2C"��C � ��QT=M# C"C"��\;>+4 ��tLH;��(IH���CL: JB:��+>�:<\;>�4h�$#K:��;#<�$H;4R!L:��):<>�V2wR4R!�C$: V �2:x%&��C$(r#�')!$C"4:<�M:<>�V wA4R!@�"H):<�G�I:���4sCh�$H;45(r#�� �$4r82�0��� �"#O:�(R(R#�';� �s�/1&')(IH : =;!"4� :��):<>�V&CU��Ch!$4A%;')(r4sC

Page 22: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�Ay �������������� ������������������������������ !�

�"H)4/t�#,! �D#�Q��$H;47%&��C"(R#�';!ICU4.:<�M:<>�V wA4R!s�Z[!I:�(r�"��(R:�>2C"V&Cb�$4R3DC93x')Cb� %;4A:<>)tL���$HD4R!$!"#,�;4R#,')CT�+�;=)'&��:�CvtP4R>�> �T6 J�4R�5�+Qz:��5�+>�>��Q #�!$354A% '&�U�$4R!I:<�)(R45~�tLH;4r�$H;4R!�tL�+�"H;��� #�!PtL���$H;#�';�L(R#�� �"4R82�I����CPi,�+J,4R� � �"H)4.C"V&Cb�$4R3

C"H;#�';>�%�35:���40:xi,';4AC$C��"#K#�\&�I:<��� �$H;4.�+� �$4R�)%&4s% 354s:<�;���;i)� ��H;4/C"V&Cb�$4R3 3D: VDi�4R��"H)47')C"4R!L�$#DJ�4R!$�+Q V��"H)47354A:<�)�+�;i �;#�!GCU4A4 � H)��CLH)4R>�=��+�](A:�C"40�+�@��C@:�\;>+4.�$#D#�\&�I:<���#��)>+V}: =):<!"�"��:<>9354A:��;���;i)�ON�';� �+� :�� V}(R:,CU4��n�"H)4�!"4sCU=Y#��MCU4K�"#�\Y4�=;!$#&%&')(R4A%}��C35#�!$40�"H):��xab'MCb�@:,(R(r4A=&�L#�!L!$4bab4s(*�A�

� Qv�"H;4K:<\Y#BJ�47:�!"i,';354R� �$Ch:�!"4x:�(R(R4R=&�$4A% �M�"H)4 (r#,� J,4R� �"��#��M:<>n�;#��"��#���#�Q[i�!I:<3 �3D:B�$��(A:<>����bV ';�)%&4A!"i,# 4sCD:�(IH):<�;i,4��u���MCb�$4A:�% ��#,�;4](R:���C"H;�+Q �D�"# :�J2��4Rt��"H):<� :C"4R� �"4A�)(r4]HM:�C�: 354s:<�;���;i tL�+�"Hd:��u:�C$CU#&(r��:B�$4A% (r# Cb� !$4Ri :<!I%&���;i :�(R(R4R=&�I:<\;��>����bV,�|lH;4A� �$H;4/(r#,CU����C�wA4R!$# �2���L��C�: i,# #&%�CU4A�,�$4R�)(R4D~ #�!L(R#��2J�4A�,�$�+#,�):<>�>�VK:Ki�!I:<353D:B� ���(R:<>9C"4R� �"4A�)(r4 �*�x|lH;4R� �"H;4D(R#,CU�0��C0>+#Bt �z�$H;4DCU4A�,�$4R�)(R4KC"#�')�)%;C0#&%;%-\)'&�/35:���4sCC"4R�)C"4��.?@CG�"H)4x(r# Cb�0�+�M(r!$4A:�C"4AC��M�"H;45CU4A� �"4R�M(r4xC"#�')�)%;CG3K#,!"4K:<�)%]3K#,!"4 #2%)%]';����"��>[�+� Cb�$#�=)C.3D:�� ���;i�C"4R�)C"4��D_�#,!"4Ki�4A�;4R!I:<>�>+V �$H;4R� ��: CU4A� �"4R�M(r45H):�C/:,C"C"#&(r��:B�$4A%354A:��;�+�)i ��(r#,CU�v=):<��!$CA��? i,# #&% =):<!ICU4A!9CUH;#,';>�% =;!$#&%&')(R4 �$H;4L=):<��!IC�tL�+�"HK>�#Bt�4A!v(R#,CU� )!ICb�s�@� Q : >+#Bt (r# Cb�G=):<��!G��Ch!$4bab4s(*�$4A%�\Y4A(A:<')C"4 #�Q9�"H;4K(r#�� �$4r82���M�"H;4K�;4R8 �0H;��i�H;4A!(r# Cb�L=):��+!L��CL(r#,�)C"��%&4A!"4s% �;:<�M%OC"#K#��n���H;4 >�:��;i�'):�i�4�';�)�+J,4R!IC":�>�C �;#Bt :�(R� ';��!$4-: J,4R!$V %&� �z4R!$4R� ��354A:��;���;i tLH;4A�

(r#,35=):<!$4A% tL�+�"H��"H)#,C"4]�+���bV2=Y#�>�#�i,��(A:<>L#�! i�4R�)4R!I:B�"��J�4�:�=;=;!$#,:�(IH)4ACA� ��H;4]')�;���J�4A!$C$:<>�C�!$4R>�:B�"47�"#����&Q #�!$3D:B�$�+#,�]:<�)% �+�$C0(r#&%&���;i)�h124A4R��Q !$#�3��"H)��C@=M#,�+� �G#�Q9J ��4Rt �C"#�354�C"4R4A3K���;i,>+V.%&��J�4R!IC"4[=;H;4A�;#�354R�M:h#�!T(R:<�"4Ri,#�!$�+4sCz�"')!"�7#,'&�q�$#@\Y4P:@3D:<�;�+Q 4ACU�$: ��"��#���#<Q��$H;40C$:<3540�+�;Q #�!$35:<�"��#��D�$H;4R#,!"4R�"��(@(R#��)(R4R=&�s� f #�!P4r8;:<35=;>�4 �&(A:�C"4h4R�)%;�+�;i C �=;!$4R=Y#,C"���$�+#,�):<>&:��)%K=M# Cb�$=M# CU�+�"��#��):�>&3D:<! ��4R!IC�� :��)%Kt�#,!$% #�!I%&4R!T�$';!"�5#,'&�v�"#/\Y4h:<> ��"4A!"�M:B�"��J�4Lt�: V&C9#<Qn(R#2%;�+�;i/���&Q #,!"3D:B�$�+#,��:<\Y#�'&��tLH;��(IH�%;���z4R!$4R� � >�:<�;i,'):<i,4ACv3D:��,4%&� �Y4A!"4A� �@(IH;#���(r4sCR� f !$4R4/tP#�!I%�#,!$%;4R!h:<�M% =Y#,C"���$�+#,�):<>�>�:<�)i�'):�i�4AC�:�!"4/C"�+35=;>�V��btP#4r82�$!"4A3K4sC��+�O�$H;47CU=Y4A(r�"!$';3 ���H;4 ���&Q #�!$3D:B�"��#�� �"H;4A#�!$4r�$��(O:<=;=)!"# :�(IH :�>�C"#}=;!"��#�!$�+�"��wR4ACx���&Q #�!$3D:B�"��#�� �[�"H2')C

=;!$#&%&')(r���;i�:D=)!"��#�!$���bV�:<35#��;i�%;4RJ2��(R4ACL'MCU4s% \ V �"H;4 >�:��;i�'):�i�4.�$#D!"4A=;!"4sCU4A� �@%&��Q �Q 4R!$4R� �0=):<!"�$CG#<Q[���&Q #�!$3D:B�$�+#,�n� f #�!04r8;:<35=;>�4 �M�"H;4R�$:�!"#,>+4sChtP#�';>�% \Y4K(R#��)C"��%;4R!$4A%35#�!$4G��35=M#,!U�I:<� �P�"H):�� �$#�=;��(R:�>+��wA:<�"��#�� ���&Q #,!"3D:B�$�+#,��:,C �$H;40Q #�!$354R!�: �z4A(*�IC�i�!$#,C$C354A:��;�+�)i �)tLH)4R!$4A:�CL�"H;47>�:B�"�"4A!@\;!$�+�)i,CL#,'&�0:5�2'):��)(r4,� ��H)��C@t�#,';>�% HM: J�4/!I:<35�� �(R:<�"��#���Q #�!h(R#2%;�+�;i5tLH;4A!"4AJ�4A!P:5(r#,� � ��(*�h:<!$��CU4sC�\Y4r�btP4R4A�O�"H;4/%&4AJ ��(r4sC��;4R4s%&4A%�Q #,!�"H)4R3 �

?P�O�"H;4�(r#,3K=)'&�$:<�"��#��):�>0>�4RJ,4R>G�"#2# �@�"H;��C�:<=)=;!"# :�(IHlH):,C ��35=M#,!U�I:<� ��(r#��MCU4�� ';4R�M(r4ACA� 12�+�M(r4O>�:��;i�'):�i�4�#BJ,4R!$>+# :�%;C (r#�� �$4R� �xtP#�!I%;C7tL�+�"H CU4AJ�4A!$:�> 354A:��;�+�)i,C��Q ';�)(r�"��#�� tP#�!I%;C/tL�+�"H C"4RJ,4R!I:<>9i�!I:<353D:B�$��(A:<>[!$#�>�4AC���:��)%�')C"4AC/#��"H;4A! %&4AJ ��(r4sC C"#:�C7�"#-(R#&%&4 C"4RJ�4A!$:�> �2�+�M%;C7#�Q����&Q #,!"3D:B�$�+#,� ���"H;4�=;!"#,\;>�4R3 #<QL�):B�$';!I:<> >�:<�)i�'):�i�4=):�!$C"�+�)iG(R:�� \Y4�!$4ACU�$:<�"4s% :�Cq�"H)4P=)!"#,\;>+4A3�#<Q)!$4AC"#�>�'&�"��#�� #<QM:�3 \;��i�';�+�bV�� ��H;4�!"4sCU# �>�'&�"��#��D35��i�H � =Y4R!"�$:<���5�"# ��>�4r8&��(R:�>M:<3x\;��i�';�+�bV � Cb�$!"')(r�"';!I:<>M:<3 \)�+i,';���bV��<�$#�=;��(R:�>+��wA: ��"��#���:<3 \)�+i,';���bV��,i,!$:�3535:<�"��(R:�>)!$#�>�4@:<3x\;�+i,';�+�bV �2:<�):�=;H;#�!I:.!$4rQ 4R!$4R�M(r4G:�3 \;��i�')���bV��� '):<� �$�� )4A!xC$(r#,=M4�#,!x%&4A=M4A�)%&4A�)(rV :<3x\;��i�';�+�bV �T4r�I(<�-?@� ���&Q #�!$3D:B�"��#����$H;4R#,!"4R�"��(=):�!$C"4R!.tP#�';>�%-�)#�!$35:�>+>�V�\Y4�%&4AC"�+i,�;4A% \2V-CU�"')%&V2���;i tLH;4R!$4K�"H;4D���&Q #,!"3D:B�$�+#,�]�$#!$4AC"#�>�J�4G�"H;47:�3 \;��i�';�+�bV�!$4AC"��%;4AC��2:��)%OH;#Btd�+�@(R:���\Y4/=;!$#&(r4AC$C"4A%��

Page 23: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �� ��� ���� � �� �,�� ����C���35=M#,!U�I:<� � �$# ';�)%;4R!ICb�I:<�)%��$H;4 %;���z4R!$4R�)(R4AC \M4R�bt�4A4R�ui,#,:<>�C�:��)%u:<= �=;!$#,:,(IH;4AC/#�QG(r#,�2J�4R� �$�+#,�):<>[>����;i�';��CU�"��(RCK:<�)% (R#�35=;'&�I:B�$�+#,�):<>P>+���;i,';��CU�"��(RCA� f ��!$CU���

(r#,�2J�4R� �$�+#,�):<>9i,4R�;4A!$:<�"��J�4D>��+�;i,';��Cb�$��(AC/��C �+� �$4R!$4ACU�"4A%���� ��%&4R� �$��Q V2���;i��"HM:B�x:,CU=Y4A(r�\Y4A(R:�')C"4P#�QYtLH)��(IH5>�:<�;i,'):<i,4ACv(R:��K\Y4L>�4A:<!$� �9\ V �"H;4LH2';3D:��5(IH)�+>�%5CU#.4 �z#�!"�">�4AC$C">+V,���H2')C��n�"H)��C/!I:<��C"4AC.� ';4ACU�"��#��)C/:�\M#,'&�/�"H)4DH ')35:�� 35���)%���1&4A(r#,�)% �T(r#��2J,4R� �"��#��):�>>��+�;i,';��Cb�$��(AC7��C7���,�$4R!$4ACU�"4s% ��� i���J2�+�)i]:�i�!I:<353D:<!/#,!7i�!I:<353D:<!.Q !I:<354RtP#�! � �n\;'&�%&#24ACT�;#��9=): V/:B�U�$4R� �"��#��x�"#G�"H)4�:,(*�$'):<>2=;!$#&(r4AC$C"�+�;iG#<QzCU4A�,�$4R�)(R4ACT')C"�+�)i@�$H;4�i�!I:<3 �3D:<!s�D?@C/:O!"4sCU')>�� �n�"H)4Di�!I:<353D:<!IC@#,!/i�!I:<353D:<!GQ !$:�3K4At�#,! �&C0%&4RJ,4R>�#�=Y4A% \2V-�+�#<Q �$4R�K(R:<�)�;#<�v\M4��$:���4A�x:<�M% (r#,35=;'&�"4s%7tL�+�"Hn�[XG�7�$H;4�#��;4�H):<�M%7�$H;4R!$4 ��Cv:@=;!$#�\ �>�4R3 #�Q 4 ��(r��4R�M(rV�#<Q�(r#,3K=)'&�$:<�"��#�� ��#,�]�"H)4K#��"H;4A!.H):<�)%]�"H;4A!"45��C.: =;!$#�\)>+4A3 #<Q4 �z4A(r�"��J�4A�;4AC$C.#<QL(r#,3K=)'&�$:<�"��#��l~ #,!7(r#�35=;';�$:<\)�+>����bV;�r� ��H;45Q #�!$354R!/��35=;>+��4AC/�"H):<��"H)4��"H)4R#�!$��4AC :�!"4�CU')(IH �"H):<�x�+Q@#��;4 �"!$�+4sC/�$# (r#,35=;'&�"4�tL���$H �$H;4R3 �9�+�x!$4A� ';��!"4sC4r8;(R4AC$CU��J�4�!$4AC"#�')!$(R4AC7:��)%��"��354�� ��H;4�>�:B�"�"4A!xC$: V2C7�"H):<� �$H;4 �$H;4R#,!"V�(R:��;�;#��x\Y4')C"4A%OQ #,!@(r#,3K=)'&�$:<�"��#���\Y4A(R:�')C"47�;#D354A(IH):��;��(R:<>q=;!"#&(R4A%&';!$47(R:���\M4x%&4 )�)4A% Q #,!�+�A� ��H;��!$% �Mi,4R�;4A!$:<�"��J�4.>+���;i,';��CU�"��(RC@H):�CG(r#,�)(r4A�,�$!$:<�"4s%�#,����%;4R� �"�+Q V2�+�;i�';�;��J�4A!$C$:<>�C:�(R!"# C"C�:<>�>z�):B�$';!$:�>z>�:��;i�'):�i�4sC � \;'&��H):�C�: J,#���%&4A%DtL!$�+�"���;ix4R8&H):<')CU�"��J�4Gi�!I:<353D:<!ICQ #�!h:��2V�=):<!"�"��(r')>�:�!P>�:<�)i�'):�i�4��

�S� ���E� � {~��� �Q{ ��}�{��*� =Y4R!"�$:<���)C@�"# (r#,3K=)!"4AH;4R�)C"��#��]:<�M%]i�4A�;4R!I:B�$�+#,��#<Q �M:B�"')!$:�>>�:<�;i,'):<i,4��"H;4ht�: V =Y4R#,=;>�4@:�(r�"'):�>+>�VK%;#/�"H;4sCU4G:�(*�$�+J2�+�"��4ACA� f #�! 4r8;:<35=;>�4 � ��Qn:/=M:<! ��"��(r')>�:�!@CU4A� �"4R�M(r47(r#,�)CU�"!$')(*�$�+#,� �I:���4sCL>�#��;i,4R!��"#�(R#�35=;!$4RH;4A�)% �;=MCUV&(IH;#,>+���;i�')��CU�"��(�"H)4R#�!$V.�"!$��4ACT�"#/:,(R(r#,';� ��Q #,!9���s�T?@>+>;�"H;��Cv!"4s� ';�+!$4ACv(A:<!$4rQ ';>;%&4sCU��i��x#<QY4r8&=M4A!"��354R� �$C:<�M%D%;:B�I:/(r#�>�>�4A(*�$�+#,� �,:��)%x�"H;4A#�!$�+4sCv�"# 4r8&=;>�:<���x�$H;4R3 �9|lH;4A�5�"H;4h�"H;4A#�!$�+4sC9\M4A�+�)i(r#,�)CU�"!$')(*�$4A% :�!"4 (r#,35=;'&�$:<�"��#��):�>L�+� �):<�"';!$4 � �"H;��CD:�(r�"��J �+�bV Q�:�>+>�C5';�)%&4A!D: �)4Rt )4A>�% (R:�>+>�4A% � � � �q{~}�{ � ���N�*{ ���«� � �

� Qq�$H;4/35#<�$�+JB:B�$�+#,����CP�"#5\;')�+>�%O')CU4RQ ';> �@p�Z�CUV&CU�"4R3DC��2�"H;4A#�!$4r�$��(A:<>z>+���;i,';��CU�"��(RCtP#�! �O35��i�H �7CU4A4R3 �$# \M45';�;�)4A(r4sC"C$:<!$V��K?h�2V-:�=;=;!$#,:�(IH]�"H):<�.tP#�! �&CGC"H;#,';>�% \Y4i�#2#&%�4A�;#�';i,Hn�7Sh#BtP4RJ,4R! �;�$H;4D:�(*�$�+J2�+�bV \M4A�+�;iO35#&%&4R>�4A%-��C.C"#O(R#�35=;>�4r8 �"H):<�.:,%H;#&( C"#�>�'&�$�+#,�)Cx:�!"4 ';�;>�� �,4R>�V �$# tP#�! �z�-? CU#,=;H;��Cb�$��(A:B�"4s% ';�)%;4R!$>+V2���;i]�$H;4R#,!"V}��C4AC$C"4R� �"��:<> �]?P� �$H;4�C$:<354D�$�+354 �v�$H;4 =)!"4sCU4A�,�KCb�I:B�"4 #<Q �2�;#BtL>�4A%&i,4D��CKCU'M(IH��"H):<�#�')!h�"H)4R#�!$��4AC@:�!"4 �+�)(R#�35=;>�4r�$4 :<�)%��"H;4A!"4K:<!$4/J :,Cb�0i,:�=)Ch���]#�')!@';�)%;4R!ICb�I:<�)%&���;iM�|lH;4A!"4AJ�4R!K�$H;��C5HM:<=;=Y4R�)C��P=M4A!5Q #�!I(r4 t�4OtL��>+>@:,%&#�=;�KtLH):<�"4AJ�4R!DC"#�>�'&�"��#��MCK�"H):<�tP#�! �Y� ��H2')C��&�"H;4A!"4.tL��>+>q\M47:5(r#,35=;!"#,35��C"4��

��#�35=;';�$:B�$�+#,�):<>z>��+�)i�';��Cb�$��(AC.~ ')C"4A% C"V �)#��2V23K#,')C">+V5tL�+�"H��@pqZP��H):�C�3x')(IH��$#>�4A:<!$� Q !"#,3 >+���;i,';��CU�"��(RCA��Sh#BtP4RJ,4R! �z�"H;45�$H;4R#,!"��4AC/%;4RJ�4A>+#,=M4s%-���}�"H;4D>�:B�"�"4A! )4R>�%3 'MCb� \Y4�:,%;:<=;�"4A%�#,! !$4RtL!$���"�"4A���"#-C"';�+� �"H)4��;4R4s%;Cx#<Q �@p�Zv�vX@Q �"4A� �v�"H)4 �@p�ZtP#�! ��4R!ICL��i��;#,!"47�"H;4Kt�#,! � %&#,�;4x���->����;i�';��CU�"��(RC��YtLH)4R!$4A:�C0C"#�354 #�Q9�"H;4K>+���;i,';��CU�$CQ 4R4A>n�$H):B�h�$H;4R��!@tP#�! ����Ch%&��!"4s(*�$>+V CU')���I:<\;>�4.Q #�!0(r#�35=;';�$:B�$�+#,�n��NP#��"H �"H)4AC"47J2�+4AthC�;4A4A%��"#D(IH):��;i�40�"# )�M%O:5(R#�3535#��O3K4A4r�$�+�;iD=Y#���� �A�

� hoBQFE?/LMB U LMA1moHpJo[S@:�')C$CU4A!K~U�A���,�,�@%&��C$(r'MC"C"4ACG�+35=Y#�!"�$:��,�.��C"C"';4AC0���}(R#�35=;'&�I:B�$�+#,�):<>T>+���;i,';��CU�"��(RC

:<�M%5H;#Bt �$H;4@(R#��)(R4R!$�)C9:<!$4h%&� �Y4A!"4A�,� Q !"#,3 �"H)#,C"4L�+�D>��+�)i�';��Cb�$��(ACR�[12H)�+4A\M4A!@~b�s����� �:<�M:<>�V wA4AC5%&� �Y4A!"4A�)(r4sC5\M4R�bt�4A4R�l(r#,35=;'&�$:<�"��#��):�>�>+���;i�')��CU�"��(RC�:��)% ~ ��H;#,35C �2V,:��M�

Page 24: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�sE �������������� ������������������������������ !�

i�4A�;4R!I:B�$�+J,4�>����;i�';��CU�"��(RCA�TNPH):�!$:<�"�&4r� :�> ��~b�s��� E<:,�q%&��C"(R')C"C (r#�35=;';�$:B�$�+#,�):<>&>����;i�';��C ��"��(RCx:<�)%��+�$C !"4A>�:<�"��#��}�"#->+���;i�')��CU�"��(RCA� �q4A�;�):��,�O~b�A�,�;� �G%;4AC$(r!$�+\Y4ACx(R:�C"4�CU�"')%&��4AC:<�M% =;!$#BJ2��%;4ACx#BJ�4R!$J2�+4AthC #�Q0C"4RJ,4R!I:<>�CUV&CU�"4R3DCA��1&4A(*�$�+#,�d�,�+� H;4A!"4O��C5\M:�C"4A% #,�NPH):<!I:B�$�z4r�@:<> �h~b�s���,y<\M�r�

Page 25: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ������� � �

� � � � � � � � ��� � � � � � ��� �

� � � � � � � � � � � ��� � �

� �� � %w53. �����g4653'��8%�5 ����#&%�� �g#� ,� 53.��g465 �g.1,���K�"H;��C C"4A(r�"��#�� ��t�4L��� �"!$#2%;')(r4P�"H)4h!"4s:�%&4A!T�"#/>�:<�;i,'):<i,4�CU�"!$')(r�"';!$4��T?@C %;��C$(r')C$C"4A%����124s(<���,� E ��t�45:<!$4 =)!"��3D:<!$�+>�V](r#,�)(r4A!"�;4s%�tL�+�"H �"H;4D(r#,353 ';�;��(R:<�"��#��-Q ';�)(*�$�+#,�#<Q��):<�"';!I:<>[>�:<�)i�'):�i�4 �T��� =):<!"�"��(r';>�:<! �nH;#Bt ���&Q #�!$3D:B�"��#�����C (R#2%;4A%}�+� : �M:B�"')!$:�>>�:<�;i,'):<i,4 Cb�$!"���;i 9 :<�M%�H;#Bt �+�0��C0!"4R�"!$�+4AJ�4A%OQ !$#�3 �$H;4KCU�"!$���;i \2V]:�!$4A:,%&4R!s� ��H)4=;';!$=Y#,C"4/#<Q9��%;4R� �"�+Q V2�+�;i�Cb�$!"')(r�"';!$4/��CL�"HM:B�@�+�@tL��>+>�4ACU�$:<\)>+��CUH�:5!$4R>�:B�$�+#,�O\Y4r�btP4R4A����&Q #�!$3D:B�"��#�� �x:��)%��$H;4KCU�"!$���;i �$H):B�/(r#&%&4sC0���s� NP4rQ #�!$4 tP45(R:<�-tL!"�+�"4Ki�!I:<353D:<!IC:<�M% %&4sCU��i�� �@p�Z C"V&Cb�$4R3DC0�"H):<�/')CU4x�"H)4Ki,!$:�3535:�!$C��zt�4K�;4A4A%-�"#�CUHM:<!$=M4A�-#�')!���,�$';�+�"��#��)Ch:�\M#,'&�L>�:��;i�'M:<i�4,� ��H;��C��2�"H)4R� �;��C��$H;4/=;';!$=M# CU4.#�Qq�"H)��ChC"4A(r�"��#��n���H;4 \):,CU��( ')�;���ICD��� :}tL!$���"�"4R�lCU�"!$�+�)i}:�!"4Ot�#,!$%)CR� ? t�#,!$% ��CD:�(r#,� �"��� ' �

#�'MChCU4s� ';4R�)(R4.#<Q9:<>�=;H):<\Y4r�$��(/(IHM:<!I:�(*�$4R!IC.~ =Y#,C$CU��\;>�V ���)(r>�')%&���;i5�"H)47H2V =)H;4R�M�r� �]� �CU�$:<�M%;CKQ #�!DC"#�354����&Q #,!"3D:B�$�+#,�n� f ';!"�"H;4A!��P:<=;=)!"#,=;!"��:B�$4�C"4A� ';4A�)(r4O#<Q0t�#,!$%;CK���:}Cb�$!"���;i�(R:<� \Y4Oi,!"#,';=Y4A% �$#�i,4r�"H)4R!5�+��: t�#,!$% i�!$#�';=n� |lH):B�5�"H)��C5354A:��)CK��C�"HM:B��Q #�!LC"')(IHO:xi�!$#�')= #<Q�t�#,!$%;C�� �"H;4A!"4.��C�:x=M:B�U�$4R!$� #,!�:x!$';>+4.tLH;��(IHOH;4R>�=)C�%&4 � )�;4G�"H)4Gi,!"#,';=n�T���&Q #�!$3D:B�"��#���(R#�� �$:��+�)4A%D����: t�#,!$%Di,!"#,';=D')C"'):<>�>�V5(R#�!$!"4sCU=Y#��M%;C����C"#�354]C"V&Cb�$4R3D:B�$��(Ot�: V �"#��$H;4��+�;Q #�!$35:<�"��#���(r#,�,�I:<���;4A% �����"H;4](R#��)CU�"�+�"';4A� �tP#�!I%;CR� ���O#��"H;4A!htP#�!I%;C �&���&Q #,!"3D:B�$�+#,� ��Ch(R#�35=Y#,C"���$�+#,�):<>����]:5i�!$#�';=q� 12�+35��>�:�!">�V �:Kt�#,!$%�i�!$#�';=O(R:<�O\Y4GQ ')!U�$H;4R!h(R#�3 \)�+�;4s%��$#�i,4r�"H)4R!�tL���$H�#��"H;4A!Lt�#,!$%�i�!$#�';=)CP#,!tP#�!I%;C��"#DV2�+4A>�%O>�:<!$i�4A!Pi,!"#,';=)CA�TS@4R!$47:<i :<��� � �"H;47���&Q #,!"3D:B�$�+#,�O(R#�� �$:��+�)4A%��+�O�"H)4>�:<!$i�4R!Ti�!$#�')=xC"V2CU�"4A3D:B�"��(R:�>+>�V7(r#,!"!$4AC"=Y#��)%;Cq�"#0�$H;4L�+�;Q #�!$35:<�"��#��K(r#�� �I:<���;4A% �+�K�"H)4¼�� Ô�Ã�À�ÄÉÂ�� ÄÉÔcÇ���Ák¢ÁkÀ Ç�ÈsÃ�ÁkÀ�×�Ë Ê�ÀcÑ¢Ç�À Ç���À Ç�Ñ�����Ô�ÁkÂ*Ã�Ák ½ Á���Ñ��¢À�Ç�Ô�Á1Ê�À��NÊ�À�ÍsÏ� Ì~Â¤Ë Ê�À�×/Ç´Ã�ÄÉÊ� ½ Ç�Â8Ç�ÈÉÔ�Ê�� Á ½ Ç�ÈÉÈÉÁkÍ8Ç�Ô\×>ÁKÇ�¤ÄÉÂ����WÄ ËlÄ Ã��¢ÁkÈÉÑ¢Ô1à �¤Á À�ÁpÇ�Í¢ÁkÀ1Ã�Ê`Ӣ¢͢ÁkÀ�Ô�Ã�Ç�¢Í8Ä ÃpÏÌ~Â¤Ë Ê�À�×/Ç´Ã�ÄÉÊ�Â`ÄÉÔcÇ ½ Ã�Ó�Ç�ÈÉÈ Õ±Ç�Â`ÄÉ×>Ñ�ÊKÒ*ÁkÀ�ÄÉÔ!�¢ÁkÍoÑ¢Ç�À�Ã#" Ê�Àc×6Ӥ¢Í�Ç�¢Á1Ñ�Ç�À�Ã%$lÊ�Ëq×>ÁpÇ�¢ÄÉÂ��¢Ï&(' Ê�À�Í¢Ô>Ç�À�Á/Ã~Õ)Ñ¢Ä ½ Ç�ÈÉÈ Õ©Ô�ÁkÑ�Ç�À Ç´Ã�ÁkÍ)�*թͤÁpÈÉÄÉ×>Ä Ã�ÁkÀ�ÔTÔ�Ó ½ � Ç�Ô��¢ÈÎÇ�¢Ø8Ô�Ñ�Ç ½ Á�� ½ Ê�×>×/Ç��EÑ�ÁkÀ�ÄÉÊ�Í��* Ó¢Ê�à ǴÃ�ÄÉÊ� ×/Ç�À�Ø+��Ñ�Ç�À�ÁPÃ!�¢ÁkÔ�ÁkÔKÏ

�AW

Page 26: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�R� ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� � (r#,�)CU�"�+�"';4A�,�ICR�

|lH;4A���bt�#�#�!G3K#,!"4 ���$4R3DC@i,4r�0i�!$#�';=Y4A%���� �"#O:D>�:�!"i,4R!h')�;��� �n: CU�"!$')(*�$';!$47��CQ #�!$354A% �qtLH;��(IH�(r#,� �$:<���)C0�$H;45���$4R3DC7:<�M%]�$H;4D!"4A>�:<�"��#��)C"H;��= :�3K#,�;i��"H;4A3O� ��H)4���&Q #�!$3D:B�"��#�� #�Q��"H;4�>�:�!"i,4R!/';�;�+���9'MCU'):�>+>�V�%&4R=Y4R�)%)C7#����$H;4�CU�"!$')(r�"';!$4 �T�"HM:B� ��C ��"H)47(r#��MCb�$���$';4R� �h�+�"4R3DCh:��)% �"H;4A�+!h��� �"4A! � !"4A>�:<�"��#��)CA���#���4R4A=5�"H;4GCb�$!"')(r�"';!$4L35�+�)�+3D:<> � t�4h��� �"!$#&%&')(r4L#,�;>�Vx#,�;4 �2�+�M%5#<QnCb�$!"'M(*�"')!"4��(R:�>+>L�+� �©� ��{ � �*���P� � ��{ � � �D��}����q��}��Q� � � ��H)4R!$4OtL��>�>L')CU'M:<>�>+V \Y4O�bt�#��+�"4A35C5����:CU�"!$')(*�$';!"4.(R:�>+>�4A%D�"H;4 � � � :��)%D�$H;4 �©� ��{ � �*� � � f #�!P4r8;:<35=;>�4 �2��� �$H;4@Q #,>+>�#BtL���;iSh���)%&��Cb�$!"���;i �� � ��� ������������������������������� � ���

�):<';i,H �bV �,��C �"H)4@35#&%&�� M4R!�:<�)% \M#BV&C��,��C �"H;4GH;4A:,%��[12�+35��>�:�!">�V � ���D�"H;4@Q #�>�>+#BtL���;i ��� � �!�"��� #��%$�#����& ��'&�������()#���$�#* ��& ��+#���$�#�(-,

=;';35= ��C��"H;4/H)4A:�% �;:<�)%O��!"#,� ��C��"H;4/35#&%&� )4R!s� $ ?@i,:��+� �&���O�"H;4.Q #,>+>�#BtL���;i �#����������.�"��� #��%$ #��/�������& &�������(0#���$ #* /�������&1#���$�#2,

=;';35= ��Cx�$H;4 H;4A:,% ��:��)% t�:B�$4R!5��C5: 35#2%;�� )4A!A� �h#<�$4O�"H):<�5=)!"#,=M4A!U�$�+4sC #�Q@�"H)4H;4s:�%]:�!"47���;H;4A!"�+�"4s%]\2VO�"H;4Ki�!$#�')=n� ��H2')C�� t�:B�$4R!@=)';35= �z��C0:�=;')3K= �����.��CG�;#��t�:B�"4A!A� 3]pq�+�;i,';��Cb�$��(A:<>�>+V��;t�47C"4R47�"H):<�L�"H;47i,!$:�3535:<�"��(R:�>�=;!"#,=M4A!U�$�+4sCL#<QT�"H)47H;4A:,%:<!$4.�+�)H;4R!$���$4A%�\2V��"H)47Cb�$!"')(r�"';!$4�� ��H2')C��&�+�O�$H;47CU4A� �"4R�M(r4��4 & ��5#���$�#"1��&��6 ����7��8(

�"H)4hCb�$!"')(r�"';!$4.~ #�!9tP#�!I%7i,!"#,';=M� ��!$#��K=;';35=)C��B��Cv=;>�';!I:<>;:,C9CU4A4R�xQ !"#,3 :<i�!$4R4A354R� �tL�+�"H��$H;4xJ,4R!$\ :�!"4��+� ��H;4xCU�"!$')(*�$';!$47��CG=;>�';!I:<>T\M4s(R:<'MCU4/�$H;4 H)4A:�% ~ =;';35=)C�� �@��C=;>�';!I:<> �

�����"H)4 :<\Y#BJ�454r8;:�3K=)>+4sC �Tt�4 H): J�45��%&4R� �"� )4s%}�"H;4�H;4A:,%}:��)%}�"H)4�35#2%;�� )4A!��\;'&�K�;#<� �"H;4��M:B�"')!"4�#�QL3K#&%&� M(A:B�"��#��q�O|}4 �2�;#Bt�Q !"#,3 #,';!7tP#�!$>�% �2�;#BtL>�4A%&i,4�"HM:B�L�"H)4735#2%;�� )4A! F(R:�CU�h��!"#,� �&�+� F(R:,Cb�h��!"#,� =;';35= �;���)%&��(R:<�"4ACL�"H;473D:<�"4R!$��:<>�#�';�#<QvtLH;��(IHO�"H;47=)';35=�H):�C�\Y4R4A�](r#��MCb�$!"')(r�"4s% �;tLH;4A!"4s:�C tP:<�"4R! �&��� t�:B�"4A!L=;';35= �9 Ì~Â>¿�Ç�¤ÄÉ¢ÄÎÇ�Â;:GÀ Ç�×>×/Ç�À " ¿<:�$ �)Ô�Ó ½ �oÇ3Ô�Ã�À�Ó ½ Ã�Ó¢À�ÁGÄÉÔ ½ Ç�ÈÉÈÉÁkÍ>=@?BADC�EFAGC�H�I�JK=@?BADC�EFAGC�I�L INMOC�I�I�=%I�Ï

P ÄÉÔ!�¢ÁkÔ �*Õ�Ç6×>ÁpÇ�¢ÔMÀ�Ê�Ó����¤È ÕoÃ!�¢Á��¢ÁpÇ�Í�� Ç�¤Í`Ò)ÄÉÔ �¢ÁkÔ �¢Ç�Â�Ç6×>ÁpÇ�¢ÔM×>Ê)Í¤Ä Q�ÁkÀKÏR@S �¤ÄÉÔcÄÉÔMÔ�Ç�×���Ç�¢Í���Ç " À�ÁkÈÎÇ´Ã�ÄÉÊ� $MÊ�ÀNÒ)ÄÉÔ �¢ÁkÔ �*Õ�Ç´Å Ò)ÄÉÔ �¢ÁkÔ!��Ç�Â�Ç ����Ç�ÇkÒ�Ç ÄÉÂ`¿<:SÏT%S �¤ÁpÀ�Á«Ç�À�Á�Ô�Ê�×>ÁE×>Ê)ꢀ Q¢ÁpÀ�ÔsÃ!��Ç´ÃQ×/Ç�Ø�ÁQÃ!�¢Á«×>ÁpÇ�¢ÄÉÂ��NÊ�Ë)à �¤Á«ÊKÒ*ÁkÀ�Ç�ÈÉÈ�Ô�Ã�À�Ó ½ Ã�Ó¤À�ÁqÔ�Ó��¢Ô�à Ç�Â*Ã�ÄÎÇ�ÈÉÈ Õꢀ U ÁkÀ�ÁkÂ*ÃcË À�Ê�×�Ã!�¢Á#�¢ÁpÇ�ÍWÏ«Ð�Ê�ÀMÁWV¤Ç�×>Ñ¢ÈÉÁ��¢ÄÉÂ)X Ç\Ë Ç�Ø�Á���Ó¤Â2Y �"X ��Ó¢Â2Y¤ÄÉÔNà �¢Á#�¢ÁpÇ�Í Ç�¢ÍZX Ë Ç�Ø�Á�Y¤ÄÉÔNà �¢Á×>Ê�ꢀ Q�ÁkÀ �¢Ó¤Ã[X Ç>Ë Ç�Ø�Á���Ó¢Â2Y@ÄÉÔ1¤Ê�Ã6Ç ��Ó¢ÂwÇ´ÃTÇ�ÈÉÈ Ï S ��Ó¢Ô �QÄ Ã3Í¢Ê)ÁkÔT¢Ê�Ã#��ÇkÒ*Á à �¢Á6Ñ¢À�Ê�Ñ�ÁkÀ�Ã�ÄÉÁkÔTÊ�ËÃ!�¢Á �¢ÁpÇ�ÍWÏ S �¢ÁkÀ�Á ÄÉÔl¢Ê6Ô�Ñ�Ç ½ Á Ë Ê�ÀNÇ\Í¢ÁPà Ç�ÄÉÈÉÁkÍoÍ¢ÄÉÔ ½ Ó¢Ô�Ô�ÄÉÊ� �¢ÁkÀ�Á�Ï ' Á �cÄÉÈÉÈ+��Ä Ò*Á3Ç ½ Ê�×>ѤӤà ǴÃ�ÄÉÊ�Â�Ç�ÈÇ�Â¢Ô �NÁkÀSÃ!��Ç´Ã6Ã!�¢ÁoÑ¢À�Ê�Ñ�ÁkÀ�Ã�ÄÉÁkÔ6Ê�Ëcà �¢Á��¢ÁpÇ�Í Ç�À�Á/ÄÉÂ��¤ÁpÀ�Ä Ã�ÁkÍ �*ÕwÃ!�¢ÁoÔ�Ã�À�Ó ½ Ã�Ó¢À�Á\Q�À�Ô�à � � �¢Ä ½ � Ç�À�ÁÃ!�¢Ák ×>Ê�ꢀ Q�ÁkÍ ��Õ Ã!�¢Á1×>Ê�ꢀ Q�ÁkÀKÏ@Ì~ÂoÃ!�¢ÄÉÔ ½ Ç�Ô�Á��¢ÁPÒ*ÁkÂoÃ!�¢Á1ÁkÔ�Ô�ÁkÂ�Ã�ÄÎÇ�ÈWÑ¢À�Ê�Ñ�ÁpÀ�Ã~Õ" Ê�Ë � ÁkÄÉÂ��6Ç ��Ӣ $��ÁPÃ�Ôc×>Ê�ꢀ Q�ÁkÍ Ê�ÀMÊKÒ*ÁkÀ�Å~À�ÄÉͤ͢ÁpÂsÏ

Page 27: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ��� �� ��������������� ���� !��� � �!� ��� � �������� �� � � ����)%&��(R:B�$4ACn�"H;4 � ';��%/�"HM:B�qi,4r�$C�=;';35=Y4A%��vNP'&�q�$H;��Cq��Cn�;#��T(R#2%;4A%.���/�"H;4PCb�$!"���;iM�q|}4tL��>+>M�+�)%;��(A:B�"4h�"H;4G�):B�$';!"4L#�Q�3K#&%&� M(A:B�"��#�� �,#,�;>+Vx��Q��$H;��C[���&Q #�!$3D:B�"��#��5��C : JB:<��>�:<\;>�4Q !$#�3 �$H;47Cb�$!"���;iM�

� ��C"H;#�')>�%5\Y4h354R� �"��#��)4A%D:<i :<���K�"H):<��tP4LH): J�4h%&4 )�;4s%�:.35�+�;��3D:<>zCb�$!"'M(*�"')!"4,���H;��CGCU�"!$')(r�"';!$4x(A:<�]\Y4x4R82�"4R�M%&4A%�#,!@4A�;!"��(IH;4s% �z��Q �)4A(r4sC"C$:<!$V �Y:�(A(r#�!I%&���;iD�$#��"H)4>��+�;i,';��Cb�$��(0�$H;4R#,!"VD\Y4R���;iD')C"4A%��

NP4rQ #,!"4 t�4 >+#2#��l:<� C"#�354 (R#�3535#��;>�Vl#&(R(R';!"!$���;i CU�"!$')(*�$';!"4sC �Gt�4 �;4R4s%l�$#%&��C"(R')C$CT(A:B�$4Ri�#,!"��4ACq#<QYt�#,!$%;CT:<�M% CU�"!$')(*�$';!"4sCR��| #,!$%)C�\Y4R>�#��)i@�$#0:0CU3D:�>+>2�2';3 \Y4R!#<Q�>�4r8&��(A:<>[(A:B�"4Ai�#,!"��4AC��n#<Q�tLH;��(IH-�btP#]:<!$4535#,CU�.=)!"#,3K���;4A�,� �7�;#,';�)C/:<�M% J,4R!$\)CA���#�!$!$4AC"=M#,�)%&���;i�>�V �&�$H;4R!$4x:�!"47�bt�#D�bV2=Y4ACG#<Q9=;!$#�35���;4R� �0CU�"!$')(r�"';!$4ACx~ #�!Gi�!$#�';=MC$� ��;#,3K���):�>�C9:��)%KJ�4R!$\):�>�CA� ��H;4LH)4A:�%x#<Q�:.�;#,3K���):�>&��C[:.�)#�';�K#�![:��;#<�$H;4R!9�;#,35�+�):�> �12��35�+>�:<!$>+V��2�"H;4/H)4A:�%O#�Qv:KJ�4A!"\M:<>z��C@:xJ,4R!$\�#,!h:<�;#��"H;4A!LJ�4A!"\):�> �v? C"4R� �"4A�)(r4.tL��>+>\Y4hJ2�+4At�4s%K:,C9:.J�4A!"\):�> � ��H;4A!"4h:�!"4L:/C"35:�>+>)� ')3 \Y4R![#�QY#��"H;4A![>+4R8&��(A:<>)(A:B�"4Ai�#,!"��4ACA���H;4AV ')C"'):<>�>�V #&(R(R';!@:�CL:535#&%&� )4R!G�+��:DCU�"!$')(*�$';!$4 �;�;#��@:�Ch:5H)4A:�%n� ��H;4sCU47:�!"4 �:�%Bab4A(*�$�+J,4AC��;:�%&J,4R!$\)C�� 4R�$(��

pn4R�L')CL�;#Bt >+#2#���:B�h%&� �Y4A!"4A�,� �2���)%;C�#�QT35#&%&� )4R! � 35#&%&� )4A%OCU�"!$')(*�$';!"4sCR��,� � ���w{~� � ��}����q��}��Q� � � {~}�� �������*}�{ � ���P�«���Q��� � ��{ �S� �}�{������ �Sh4R!$4 �M�"H)4 �;#,';�]��Ch�$H;4 H;4s:�%�:��)% �"H)4x:�%Bab4A(*�$�+J,4 ��CG:��;#�35���):<> �GS@4R!$4 :<!$4CU#,3K4.4R8&:�35=;>+4sC �

������ � ������ ��& �/������� � �����

$ � ��� �������������� ��� �� ��

��H;4/�;#�')�)C�F(R:�:,%;:<!I: ��~ CUH;4A4r�*��:<�)% >�: G:�� :,: �n~�\M#BV;�L:�!"40�"H)4/H;4A:,%���� �"H)4�bt�# C"4R� �$4R�)(R4AC��)!$4AC"=M4s(*�"��J�4A>+V,� ��H;4x�):B�$';!"4 #<Q[35#&%&�� Y(R:B�$�+#,�]��Ch�;#��0(r#&%&4s%�+���"H;47CU�"!$���;i)�

E;��� �*��� � ��}����q��}��Q� � � {~}~���«���Q� � � �*���&�©� ��{ �6� �}�{���� � �Sh4R!$4 ���"H;4@J�4R!$\5��C[�"H;4@H;4A:,%D:<�)%x�"H)4@�;#,';�D��C :/35#2%;�� )4A!A�v?lJ,4R!$\5%;4R�;#��"4AC:<� :,(*�$�+J2�+�bVd~ #,!5CU�$:<�"4 � �PtLH;�+>�4O�"H;4��)#�';��%&4R�)#<�"4sC5: =M:<!"�"��(r��=):<� �5�+� �"H)4:�(*�$�+J2�+�bV-~ #,!hCb�I:B�$4s�*� f #�!L4R8&:�35=;>+4��&�+�O�$H;4.Q #�>�>+#BtL���;ix�bt�#DC"4R� �"4A�)(r4sC �

���������"��� ���� ��� (�� �� & ���

���������"��� � & ������ ������ (�� �� / �� �������#"�����

��� Ç�ÈÉÈÉÁkÍZAWI��[I�I�L I�I��@C�?���I��DI�L I ÄÉÂo¿<:SÏ��� Ç�ÈÉÈÉÁkÍ`Ø�Ç�À Ç�Ø´Ç6À�ÁpÇ�ÈÎÇ´Ã�ÄÉÊ� ÄÉÂ`¿<:SÏ

Page 28: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�A^ ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� � �"H;45:�(r�"��J �+�bV F%&#�' 0:�: �9~ !I:<�M�0:<�M%��"H)45CU�$:<�"4 C"# �9~ CU>�4R4A=M�GH): J�4 �"H;45�;#,';�3K#&%&� )4A!� >�:�0:��B:�: ��~ \Y#BV&�r�12�+35��>�:�!">�V �&���O�"H;4.Q #,>+>�#BtL���;ix4R8;:<35=;>�4.C"4R� �$4R�)(R4��

����������� � � #����������.#"��� ����� �� ��&�� ������7�� /�������& �& �����

�"H;4GH;4A:,%D��C =;�+V :�: �M~�%;!$:�� �;�[:<�M%5�"H;4035#&%&�� M4R!IC�:�!"4 >�:�0:��B:�: �M~ \Y#BV;�[:��)% =):,:<�;��� �T~�tP:<�"4R!*�*�xSh#BtP4RJ�4A!��Y���-�$H;��C/(A:�C"47�$H;45�):B�$';!"4K#<Q�3K#&%&� M(A:B�"��#�� ��C� �)#BtL�n� ��H;4 \Y#BV �)%&!$�+� �&CL:��)% t�:B�"4A!��&��C�tLH):<�hi�4r�ICL%&!$';� �z�@� �Y4A!"4A� �q>+���;i,';��CU�"��(9�$H;4R#,!"��4ACni���J�4 %&� �z4R!$4R� ��:�(A(r#,';� �$C�#�Q&�"H;4[35#&%&� M(R:<�"��#�� �� � 4�� �2�"H;4AV C"4R4.%&���z4R!$4R� ���2�+�M%;CP#<Q�!$4R>�:B�$�+#,�)C�\M4R�bt�4A4R���"H;4.�;#,';�q~�CI�P:<�)% �"H)4J�4R!$\u���u�$H;4}:�\M#BJ,4 C"4R� �"4A�)(r4sCR� f #�!O4r8;:<35=;>�4 �.c.N ~ c0#BJ,4R!$�;354R� �O:��)%N����)%&���;i2�v�"H)4R#�!$V5#�! f ��>�>+35#�!$4 � CP(R:�C"4@i,!$:�353K4A![�I:<> �2CP:<\Y#�';� �"H)4R3D:B�$��(K~ #,!�"H;4R�$:,�P!$4R>�:B�$�+#,�)C�\Y4r�btP4R4R�O�$H;4R3�tLH;4R!$4A:,CP�"H;47Z9:��;�+�)��:�� �$H;4R#,!"V :��):<>�V2wR4sC�+� �"4A!"3DC.#<Q �B:<!I:��B: !$4R>�:B�$�+#,�)CA� f #�!.�+�MCb�I:<�)(R4 ��: � ';4sCb�$�+#,�-�$H):B�/�;4A4A%;C0�$#\M45:�%;%;!"4sC"C"4A%](A:<� \M45Cb�I:B�$4A%-:,CGQ #�>�>+#BthC��h�bCG�"H;4K!$4R>�:B�"��#��-\M4R�bt�4A4R� \Y#BV �:<�)% F%&!$�+� � �M�"H;4KC":�354x:�Ch�"H):<�G\Y4r�btP4R4A� \Y#BV �M:��)% !$:�� � �z:<�M% \Y#BV �M:��)% t�:�C[C">�4R4R=)�+�;i �+� �/:<!I:��B:G�"H)4R#�!$Vx(A:<>�>�C :<>�>;�"H)4AC"4@:�C � ���} ���� �� !$4R>�:B�$�+#,�)CA�f ��>�>+35#�!$4 ~b�s��^,�,�K(R:�>+>�C5�"H)4 )!$CU���btP# :�C � ���q} tLH;�+>�4 �"H)4��"H;��!I%�#��;4]:,C� � � �*��{ ���«� ��� �@?h>�>q�$H;4AC"4 tL��>�>�\Y4x%&��C$(r')C$CU4s% �+����H):<=n�0�&�L|}4 tL��>+>T')C"47�"H)4�;4R'&�$!$:�>z�"4A!"3 #�Q � ����� �� � {~}�� �� � �Q� �*��}�� �$#D(r#BJ�4A!L:<>�>z�"H;4sCU4/!$4R>�:B�$�+#,�)CR�| 47(A:<��%&!I: tu�"H)4735#2%;�� )4A! � 35#&%&�� M4A% Cb�$!"'M(*�"')!"4/=;��(*�$#�!$��:�>+>�V�� f #�!h�"H;474R8 �:<35=;>�4Gi,�+J,4R� :�\M#BJ,4 � �"H;4/CU�"!$')(*�$';!$40(A:<� \Y4.CUH;#BtL�O:�CP��� f ��i�';!$40E;�+�,� ��H)4

��������������� �

������������������

�������������������� �!�" ��#$�������%��&('*)��f �+i,';!"47E;�+� � �@#�';�MCL:�CL:<!$i�')3K4A� �$C�#<QTJ�4A!"\

!"#2#<�x�;#&%&4 =;��� �Ti�4R�$C735#&%&� )4A% \2V �+�$CK(IH;��>�%&!$4R� >�:�0:��B:�: ��:��)% =M:�:<�)�+� �+���H;45�):B�$';!"4K#<QP35#2%;�� M(A:B�$�+#,� ��C/CUH)#BtL�-\2V�>�:�\M4A>+>����;iO�"H;454A%;i�4AC/:,C � :�!U�I::<�)% �B:<!$35:)�

W)��� �*��� � ��}����q��}��Q� � � {~}~� � ����� ¢� �� � �Q� �*��}6�k�&}~��� ��� � � ����� � +,�� Ç�ÈÉÈÉÁkÍ ��I��GI ��I �GE�- I/. ?10�L/ÄÉÂo¿<:SÏ�21Ç�À Ç�Ø�ÇSÄÉÔcѤÀ�Ê�¢Ê�Ӣ ½ ÁkÍ Ç�ÔcØ�Ç�Ç�À�Ç�Ø�ǤÏ

Page 29: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ��� �� ��������������� ���� !��� � �!� ��� � �������� �� � �Be?h!$i�';354R� �IC�#<QT(R4R!"�$:��+�OJ�4A!"\)CL:�!"40J�4A!"\MCR� ��#��MCU��%&4R!��$H;47C"4R� �"4A�)(r4 �

�����������6�����"������ �2� �"���� �6#���� ����� �6������������� (�� �� �� %$ ( �����5������5�� �2����� ������/�(* � �6�� �� �����1������5 � � ����/ � �2����� ( ,

Sh4R!$40�"H;47:�!"i,';354R� ��#<Q C$: V � ��Ch:���4A�,�$�+!$4/CU4A� �"4R�M(r4 H;4 � 4Rt�: � �+�"4��+�@��:<i,!$:�35:<�"��(R:�>+>�V��+�@��CGCUH)#BtL���+� f ��i�';!$4xE&�FE&��?@CG\Y4rQ #�!$4 �Y:�(IH;��>�% �)#2%;47��C

� ��' '�� '������!����������������� � � � �!� � ����� ������ ������ �

������������������

��#$� ����)��" ��#$���������&(' )��

������ ����������

������� ���!� )��

f ��i�';!$47E&�FE �9?�J�4A!"\�~ '�G: ��:�CL:<!$i�')3K4A� �P#�Qv:��;#<�$H;4R!�J�4A!"\�~ �B:�H):,�

:x35#&%&� )4R!L#�QT�+�$C�=M:<!$4R� �A��M� � ���w{~� � ��}����q��}��Q� � � {~}�� � ���}�{��*{ � � � � ����� ¢� � � ��{ � ��� �k� �«���Q� �

Sh4R!$4 �A�"H)4[�;#�')�0��C��$H;4[H;4s:�%0tLH;# CU4935#&%&� )4R!���Cn:�J,4R!$\n� ��H;4 J�4R!$\0�bV2=;��(A:<>�>+V#2(A(r';!IC��+���;#���� )�;�+�"40Q #,!"3�#�!�=):�!U�$��(R�+=)>+4GQ #�!$3 �v?GC�:<� 4R8;:<35=;>�4 �&(r#,�)CU��%&4A!�"H;47C"4R� �"4A�)(r4 ��� ����� ������� ������'���������"���&������"����� �� ��

tLH;4R!$4D�"H)4 H;4s:�% ��C >�:�0:��B:�: � ~ �$H;4�\Y#BV;�*� ��H)4 J�4A!"\ \;H):,:<i :B�$:,: H2'):�: �~ !$';�;�;���;i � ��C�35#&%&�+Q V2�+�;iD:x�;#�')� ~ \Y#BV;�*� ��H;40�;#,';� tLH;��(IH ��C�35#&%&�� M4A%�\2V�"H;4�J�4R!$\ � ��C�:��7:<!$i�';354R� �q#�Q&�"H;4�J�4A!"\n� ��H;4 �M:B�"')!"4[#�Q&�"H;4P=):�!U�$��(R�+=;>�49Q #,!"3%&4r�$4R!$3K���;4sCGtLHM:B�.�"H;4�:�!"i,';354R� �G��CA�x��� �"H;4�:�\M#BJ,4 4R8&:�35=;>+4�� \;H):<i :B�I:�:

Page 30: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�A� ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� � H 'M:�: � H):,C[�$H;4 �I:�:xH 'M:�: �,Q #�!$3 tLH;��(IH ���)%&��(R:<�"4AC �B:<!"�$: !"4A>�:<�"��#���tL�+�"H��"H)4�;#�';�O�+�h3K#&%&� )4sCR���H;��CT��CvCUH;#BtL�x%&��:�i�!I:<353D:B�$��(A:<>�>+V0�+� f �+i,';!"4LE&� W;�q� �9C"H;#BthCq�"H):<� >�:�0:��B:�: �

&������� � ��� �� �

��������� . 9

" ��#$������� � & ' )��

f ��i�';!$47E&� W�� �h#,3K���):�>�tL���$HOJ,4R!$\):<>�35#&%&� )4R!

~ \Y#BV&�L��Ch�"H;47H)4A:�% tLH)#,C"4735#2%;�� )4A!@��C \;H):,:<i,: �q~ !$';�M�r� ��H;47!$4R>�:B�$�+#,�O\Y4 ��bt�4A4R�.�"H)4R3 ��C��+�2J,4R!ICU4 �B:<!"�$: �A���/#<�$H;4R!�t�#,!$%)C �A�"H;4�=):<!$4R� �n�;#&%&40~ >�:�0:��B:�: ���CP�$H;4��B:<!"�$:K#<Q��"H;47(IH;��>�%��)#2%;4�~ \;H):,:<i :,�*�

�;��� �*��� � ��}����q��}��Q� � � {~}~� � ������� � �����&� � ��{ �S� �}�{���� �XG�;4 #�Q[�"H;4KJ�4A!"\MC@��CG�"H;4KH;4A:,%-:��)%��$H;4x#��"H;4A!.��C.:�35#&%&� )4R!.\;';�0�;#��.:��:<!$i�';354R� ��#<QT�"H;4/J,4R!$\n�9Sh4A!"4.��CL:<� 4r8;:<35=;>�4��

���������"���+���%$ � ��������"��& � �����&�� � ������� (�� �� $2����� .���7���������������� � %$2�!/ �����*�� ��7������ ���������+�� � $ ����� � ����6�� ��5/������5� @$2�<( ,

Sh4R!$4 �Y�$H;45=):<!"�"��(r��=;>�47Q #�!$3 � HM:�:��B:�!$: ��~ HM: J ���;i � 4s:B�"4A�M�L��C0!"4A>�:<�"4s%��"#��"H)435:��+�-J�4R!$\ i,: V :�: �T~ tP4R� �I�r� ��H;4K�):B�$';!"4x#<Q !$4R>�:B�$�+#,�]��C@�$4R35=Y#�!I:<>T=;!"4s(r4�%&4R�)(R4�� ��� #��"H;4A!7t�#,!$%)C ���"H;4 4A:B�$�+�)i-:�(r�"��#�� #&(R(R';!"!$4A%}\Y4rQ #,!"4D�$H;4�i,#����;i:�(*�$�+#,�n�[12��3K��>�:<!$>+V��&t�4.H): J,4G�$H;4.Q #�>�>�#BtL�+�;iK4r8;:�3K=)>+4 ����������"���+���%$ � �������� ��� �� ���5�����&�� � ������� (

�����������* � �6�� ��6/ �����5 %$2�� ����������� � $ ������ ( ,

Sh4R!$4/�$H;4xC"4A(R#��)%�:,(*�"��#�� ~�i,: V :�:,���$#2#��O=;>�:,(r47tLH)�+>�47�$H;4 )!ICU�G#��)47tP:,Ch���=;!"#,i�!$4AC$CR���H;4D35#2%;�� )4A! � 35#&%&�� M4A%}!"4A>�:<�"��#��)C.�����"H)4 )!$CU� 4R8&:�35=;>+4DC"4R� �"4A�)(r4�:�\M#BJ,4:<!$4xC"H;#BtL�-:�CG��� f ��i�';!$4KE;� �M� ��H)4xJ,4R!$\-�;#&%&4 aU:,: �v~ i,# �@��C035#&%&�� M4A%]\2V���ICP:�!"i,';354R� �$C >�: G:�� :,: �z~ \Y#BV;��:��)% i�HM:<!I: �z~ H;#,3K4 �P:�C�t�4A>+>�:�C��$H;4.J�4R!$\

Page 31: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ��� �� ��������������� ���� !��� � �!� ��� � �������� �� � �s�

���/�����!����!� ���('��!� " ������� � ��� �� �

����� �%� � �� �' �

������ �

� ����� � � ���������'�� � �

���������&('*)��

" ��#$�������

� ��� ���' � � ��' '�� '���� � )����� �

������ �������!�

f ��i�';!$47E&� � �9?�J�4A!"\�� J�4A!"\�35#2%;�� M(A:B�$�+#,�

�2H):,: �q~�4A:B�*�*���h#��"4/�$H):B�.CU���)(R4 >�:�0:��B:,: �;#&(R(R';!ICL#��;>�V #,�)(r4��)�+�G��C@C"H;#BtL�#��;>�V@#,�)(r4[4AJ�4A�G�$H;#�')i�H/�+�qH):<=)=M4A�)Cn�$#L\M4 �B:<!"�$:�#<Q&\Y#<�$H.�"H;4�J�4R!$\)CA�n|lH;��(IHJ�4R!$\-�+�/35#2%;�� )4sC �q��C/%&4R�"4A!"35���;4A%}\2V�>+#2# � ���;i :B�.�"H)4�CU4A�,�$4R�)(R4K(R#��)CU�"!$')( ��"��#�� :<�)%�CU')(IH��"H)�+�;i CL:�C�:<i,!"4A4R354R� �s�������"H;4/C"4R� �"4A�)(r4.';�M%&4R!h%&��C$(r')C$CU��#�� � >�:�0:��B:�: �n:<i,!"4A4AC/tL�+�"H��$H;4�J�4A!"\ i,: V :�: �[~�t�4A� �I�*� � Q��"H)4 i�4A�)%&4A!7#<Q��"H)4�;#�';����C (IH):��;i�4s% �"#�Q 4A3K���;���;4 >�:�0:��2�+� � ~�i���!"> � ���"H;4�i�4A�)%&4R! #<Q��"H;4 J�4R!$\:<>�CU#5(IH):<�)i�4AC��$#5Q 4R35�+�)�+�;4 � i : V2�+� �n~ tP4R� �I�r�

^)� � ���w{~� � ��}����q��}��Q� � � {~}�� � �*��� � �«���Q�E� �?lJ�4A!"\):�>)�;#,';�D\Y4RH): J,4AC[>�� ��4@:/�)#�';��\)'&���+��3D:<��� �$:��+�)C 3D:<�2Vx#�Q����IC =;!$#�= �4R!"�"��4ACO:�CO: J,4R!$\n�����d=):�!U�$��(R';>�:�!��G��� 3D:<��� �$:<���)C����IC !"4A>�:<�"��#��)C tL���$H �+�$C:<!$i�';354R� �ICR�v|lH):<�L�"H;��CL354A:��)C���CL�"H):<�h���ICL35#2%;�� )4A! � 35#&%&�� M4A% Cb�$!"'M(*�"')!"4sCH): J�4D�$# \Y4O��%&4A� �"� )4A% :�Cx')CU'M:<>�Q #�!5J�4A!"\)CA�}��� �"H)4 Q #,>+>�#BtL�+�)i-CU4A� �"4R�M(r4 �Q #�!�4r8;:<35=;>�4 �24AJ�4R���"H)#�';i,H aU:�:<�M:�: ��~�i�# � ��CL: J,4R!$\):<>z�;#,';� �&�+��3D:��+� �$:��+�MC!"4A>�:<�"��#��)CPtL�+�"H ���ICh:<!$i�')3K4A� �$C.~�gh:�3�:��)% H)#�354s� �

& �@$ �.�"���6�����&��������� ��� $ � �������" 6� � ������+����� ��� (� �@$ - � %$2� � ���� �� � ��� ���<( � � � �������* � ����� �������1� � � ��� � �%$ -6� ������5� @$2�<( ,

:�:��):�: �����ICU4A>�QL��C :<� :�!"i,';354R� �7#<Q��$H;4�3D:<��� J�4A!"\ :,C7CUH)#BtL�}��� f ��i�';!$4E&�F�&���H;4.J�4R!$\):�>Y�)#�';�)C@(R:<�O')C"'):<>�>�V�\M4/��%&4A�,�$�� M4A%O\2VD�"H;4A�+!@4R�)%&���;i C�#�!h:<';82��> ���:�!"��4ACA�

Page 32: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

E<y ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� �

� ' ������

������� ����'�� � ��!����� �

� ��� ���' � � �&�� " �/�'���

������������������

������������������

� ��� ����� " �� �%� � � � " �' ' � �

f �+i,';!"47E;� ��� �94R!$\):<>��;#,';�

��H;4�CU�"!$')(*�$';!$4AC/%&4 )�;4A%�H)4R!$4DtL�+>�> \Y4�:�%;%;4A% �"#-:��)%}4R�;!$��(IH;4A% �+���$H;4 C"4A( ��"��#��MC �$H):B�PQ #�>�>�#Bt/�TNP';��>�%;�+�;i5C"')(IH�CU�"!$')(*�$';!$4AC Q #�!P�+�;=)'&�hCU4A�,�$4R�)(R4AC�tL�+>�>�CU4A!"J,4G:,C�"H)4Di�#,:�>�#�Q �$H;4 �@p�Z C"V&Cb�$4R3DCA�x���}#<�$H;4R!/tP#�!I%;C��nCU')(IH}Cb�$!"'M(*�"')!"4sC.H): J�4x�"# \Y4=;!$#&%&')(r4s%�:�'&�"#,3D:B�"��(R:�>+>�V :<Q �"4R!h:��):<>�V&CU��CA�

� ��� � 7w,/.37|'�,�� ��� ��#&%�� �g#� , ! %g#�����>,o.

Z9:<!IC"�+�;i ��C�:7=)!"#&(r4sC"C�\2VDtLH;��(IH�:<���+�)=;'&�hCU4A� �"4R�M(r40��C�:<�M:<>�V wA4A%�:��)% :,C"C"��i��;4s%D:C"';���I:<\;>�4.Cb�$!"')(r�"';!$4��9Z9:�!$C"�+�)i7=;!$#2(R4AC$C 3D:���4AC�')C"4G#�Qq�btP#x(R#�35=M#,�;4R� �IC �9:x=):<!ICU4A!tLH;��(IH���C7:O=;!$#&(r4s%&';!I:<>[(r#,35=M#,�;4R� � ~�:�(R#�35=;'&�$4R!/=;!$#�i,!$:�3�� �q:��)%�:�i,!$:�3535:�!tLH;��(IH���CG%&4A(R>�:�!$:<�"��J�4,� ��H;47i,!$:�3535:�!h(IH):<�)i�4AC@%&4R=Y4R�)%;�+�;i #�� �"H)47>�:��;i�'M:<i�40�$#\Y4 =):�!$C"4A% �TtLH;��>+4��"H;4�=):<!ICU4A!7!$4R3D:<���)C/';�M(IH):<�;i,4A%�� ��H2')C��v\ V�C"�+35=;>�V}(IHM:<�;i ����;iO�"H;4Di,!$:�3K3D:�!��z�$H;4�CUV&CU�"4A3 t�#,';>�%-=):�!$C"4D: %&���z4R!$4R� �/>�:<�;i,'):<i,4��5N�#��"H}�"H)4i�!I:<353D:<!P:<�)%D�"H;4.=):�!$C"4R! ��H;#BtP4RJ,4R! �,%&4A=M4A�)%�#��D�$H;4Gi,!$:�3535:�![Q #,!"3D:<>���CU3 � f #,!4r8;:�3K=)>+4��,Q #,![�$H;40Z9:��;���;��:��DQ #�!$3D:<>���C"3 �,#,�;4G(A:<� %;4RJ�4A>+#,= :7=M:<!ICU4A! tLH;��(IHD�$:���4sC:<�2VKi�!I:<353D:<![tL!$�+�U�"4A� ���D�"H)4hQ #�!$3D:<>���C"3 :<�)%�=):<!ICU4sC[C"4R� �"4A�)(r4sC[�$H):B��:<!$4@CU=Y4A(R��� )4s%-~ #,! i,4R�;4A!$:<�"4A%M�9\2VK�"H;40i�!I:<353D:<!s� ��H2')C�� �"H;4G=):<!ICU4A!�%&#24sC �;#���(A:<!$4LQ #�!��"H)4i�!I:<353D:<!0#�!0�$H;45>�:��;i�'):�i�4��Y\)'&�7#��;>�V Q #�!0�$H;4R��!/�+� �$4R! � !$4R>�:B�$�+#,�n�x12��35�+>�:<!$>+V����"H)4i�!I:<353D:<!PQ #,!h:x>�:<�)i�'):�i�4.%&4R=Y4R�)%)CL#����"H;4.Q #,!"3D:�>+��CU3 �

XG�;4G#<Q��"H)4 �,4RV5�,')4ACU�"��#��)C �"H):<�P�)4R4A%)C[�$# \Y40:��)CUtP4R!$4A%5��CP:<\Y#�'&�P�"H;40�):<�"';!$4#<Q.�$H;4]=):�!$C"4]Cb�$!"'M(*�"')!"4,� ��H;4 :<�)C"t�4A! : �z4A(r�$C��"H;4]i,!$:�3535:�!5Q #�!$3D:<>���C"3 :��)%H;4A�)(r4 �"H;4�i�!I:<353D:<! :��)%��"H)4�=):�!$C"4R! �+� :-3D:Bab#�!xtP: V,� ��H;4�(IH)#���(r4 tP4�H): J,4

Page 33: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ����� ��!����� ��� ��� � ��� ��� ������ �� � � E;�3D:�%&4O��C5\):�C"4A% #,� �$H;4�� :�!$:��B:]!$4R>�:B�"��#��MCR� f #�!5')CK�"H)4�=):�!$C"4 Cb�$!"')(r�"';!$4�Q #�!5:C"4R� �"4A�)(r4 (R#��)C"��Cb�IC7=;!$�+3D:�!"��>+V}#<QL�$H;4 J,4R!$\):<> i�!$#�';=)Cx:<�)%}�$H;4O�;#�35���):<>�C7��� �"H)4C"4R� �"4A�)(r4��;:<�)%��"H)4�� :�!$:��B: !$4R>�:B�$�+#,�)C�:<35#��;ix�"H)4R3 � �h#,��� � :�!$:��B:7!$4R>�:B�"��#��MC�35: V:<>�C"#x\Y4/=;!$4AC"4R� ��%;';4.�"#D:�%Bab4A(*�$�+J,4AC��2H;4r�$'�~�=;';!$=M# CU4 ��!"4A>�:<�"��#�� �&!$4R>�:B�$�+#,�):<>Yt�#,!$%)C>�� �,4 %;# #,!��Y~ Q�:�!I� :<�)% =):,:�C$: �)~��;4A:�!I� �,4R�$(<� ')CU�"� M(R:<�"��#��5Q #�! �"H;4.(IH;#,��(R4h#<Q�=):�!$C"4CU�"!$')(*�$';!"4x��CGi���J�4A�]���]�"H)4x>�:B�$4R!G(IHM:<=&�$4R!ICx~ Q #�!04r8;:<35=;>�4 �q��H):�=n�.�;� �r�/Sh4R!$4 �YtP4=;!$4AC"4R� ���"H;4/=M:<!ICU4.Cb�$!"'M(*�"')!"4.tL�+�"H;#,'&�G%&��C"(R')C$CU���;iKtLH V����hHM:�C�\Y4R4R��(IH;# CU4A�n��T:���4G�"H)4.Q #�>�>+#BtL���;iDCU4A� �"4R�M(r4/:�CL:���4R8&:�35=;>+4 ��2������������� ��� ��� ������ ���6 ���� ��&�$"��& � ��&�$�#��� �����"*�� ��&�$2��&1#��� �����"6���� � ��&�$ ( ,

� �htL��>+>n\Y47:�C$C"�+i,�;4A%��"H;4.Q #,>+>�#BtL�+�)iK=M:<!ICU4.Cb�$!"'M(*�"')!"4 �� �� � * #��� ����� ,�"��&�� ��)�2���������� * � ��&�$2��&2,�"��&�$ �� �� ��� � * ����&�$ ,

tLH;4A!"4� �2��C":,:<�): �A��CT�"H)4 �B:�!U�I:G:��)% �2H;4r�I: � ��CT�"H;4 �B:<!$3D:@#�Q ab#<�$: �+� ��H;��Cv��C9C"H;#BtL�%&��:<i,!$:�3K3D:<�"��(R:<>�>�VK��� f �+i,';!"47E;� ^)�

� ������� �� ������� � �!�� ��� ���� � ��������

������ �������!�� '���� � � " ' � � �

f ��i�')!"47E&� ^��9?�=):�!$C"4/Cb�$!"'M(*�"')!"4

S@: J2���;i-%&4s(r��%&4A% #�� �$H;4 =):�!$C"4 CU�"!$')(*�$';!$4 �v>+4R�K'MC �;#Bt�>�#2#���:B� �$H;4O=):<!ICU4A!CU�"!$')(*�$';!"4,�x� �7��C0Q�:<��!$>+V]#,\2J ��#�'MC@�$H):B�7:O=):�!U�/#<Q��"H;4�:��):<>�V2wR4A!���#,!0=M:<!ICU4A!03x')CU��$:���40(R:<!$4h#�Qq35#�!$=;H;#�>�#�i,V�� f #�!P4A:,(IH�tP#�!I%D�+� �"H;40���;=;'&�LCU4A� �"4R�M(r4 �&:x%&��(r�"��#��):�!"V#�![:0>�4r8&��(r#��K�;4A4A%;Cv�$#.\M4L>�#2#���4s% ')= �,:��)%x:,C"C"#&(r��:B�$4A%xi�!I:<353D:B�"��(R:�>2�+�&Q #,!"3D:<�"��#��!$4r�"!$��4RJ�4s%�� ��H)4PtP#�!I%;CTH): J,4 �$#0\Y4Li�!$#�')=M4s%/�"#,i�4R�"H;4A!9V ��4R>�%&���;i.�;#�35���):<>�C��BJ�4R!$\):�>4R>�4R354A�,�IC �)4r�$(�� f ���):<>�>+V��&�"H)4735#2%;�� )4A! � 35#&%&�� M4A%O!"4A>�:<�"��#��)CL:�35#��;iK�"H)4/4R>�4R354R� �$CH): J,4@�$#K\Y4/��%&4R� �"� )4s%�� ��H;��C���CLC"H;#BtL�O�+� f �+i,';!"47E;�Fe&�T|}4/%&��C"(R')C"C�4s:�(IH�=):<!"�L#<Q�"H)4/=):<!ICU4A!��;4r82�A�

Page 34: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

E�E ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� �

���������� �����

� � ���� ���� ��� � ���� ���� ���� ���� ��� � ������7�� ������� �� �� � ��� ���� � � $ �&�#�� ��� ���� ����� �������������& ���� ���� ���� � � � ���� ���� ���� ���� ��

/� �&� � /����� ���� �����������&��%$�$ ��� � ����� � ��� � �&�$2������ ��

�� � ���� ���� ���� ������ ���� ���� ����� 7���&�� � �&�$ �����&�� � ��� ���� � � �� ����� /� �& 1��& ���# ��& ���� ���� ���� �� � ������ ���� ���� ����

� / �& 1��&� ���#"� � ���� ���� ����� ������ ���� ���� ��� ����& ���"� �����&���� � ��� ����� � �� �&��6#���& ���& �� �����2����� �����&��� � � ���� ���� ���� ��� � ������ ���� ���� ��

�#���& �� � ���&�� ������&��

f ��i�';!$47E&� e �[1 �"!$')(r�"';!$4/#<Q��"H;4/=):�!$C"4R!

$ �%$ ��� d\BE_`?odT]kdT[THpjlA1]w:�J/A1]PR��NLMB��H;4P35#�!$=;H;#�>�#�i,��(A:<>�:��):<>�V2wR4A!n�$:���4sCq:�C��+�$CT�+�)=;'&�9:@C"4R� �"4A�)(r4�� �"H):<�T��C �B:0CU4s� ';4R�)(R4#<Q�tP#�!I%;CR� f #,!/4A:,(IH #�Q��$H;4Dt�#,!$%)C �n�+�7>�# # �&CG')=�: >�4r8&��(r#,�}:��)%-!$4r�$!"��4RJ,4AC.C"')(IH���&Q #�!$3D:B�"��#��}:�CG�"H)4D!"#2#<�.#<Q��"H;45tP#�!I% ���+�$C.>�4r8&��(A:<>9(R:<�"4Ai�#�!$V �zi,4R�)%&4A!����2';3x\M4A!��=Y4R!ICU#,� �9�"4A�)C"4 � 4R�$(�� ����(R:,CU4�� :-tP#�!I% HM:�CK3 ';>+�"��=;>�4 3K4s:<�;���;i C ��i�!I:<353D:B�"��(R:�>���&Q #�!$3D:B�"��#��}��C/!"4R�"';!$�;4s%]Q #,!74A:,(IH #�Q��$H;4D354A:<�)�+�;i CR� f #�!/4R8&:�35=;>+4��n�$H;4D35#�! �=;H;#,>+#,i���(R:�>�:<�M:<>�V wA4R!h!$4r�$';!$�)Ch�$H;4xQ #�>�>+#BtL���;i����&Q #�!$3D:B�$�+#,��Q #�!G>�: G:���4 ���-S@�+�)%;� ��;#��"40�"H):<� >�:�0:��,4 �;(A:<�O4R�+�"H;4A!h\M47C"���;i�';>�:<! � #�\;>���� ';4G#�!L=;>�';!I:<> � %;�+!$4A(r�A�

����������� �� �G&� � �� � ���������"���������� ����� ���������� �&�� �)� ��������# � � �� %$�$ ������� ���& � $2�� ��������� �����$�� ��& �)# ����& ���#���&�� �� �Z��"��& ������ � ��&�� �����

�G&� � �� � ���������"���������� ����� ���������� �&�� �)� ��������# � � �� %$�$ ������� ���& � $2�� ��������� �����$�� ��& � �������������&

Page 35: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ����� ��!����� ��� ��� � ��� ��� ������ �� � � E�W

#���&�� �� �Z��"��& ������ � ��������������

12��35�+>�:<!$>+V��2�"H;4/#,'&�"=)'&�LQ #�!� =):<HM:<�):,: �&��C �#����������� �� �G&� � �� �)# ����������

������� ����� ���������� �&�� �Z7���&��7���&��+����# � � �����"���� ��7������� ���& � $2�� ��������� �����$�� ��& � �������������&#���&�� �� � � ��&��� W�� �� �� �&1��"��&���%$ ��� �

���x�"H;4h:�\M#BJ,4 �btP#.4r8;:<35=;>�4AC��<4A:,(IH tP#�!I% ��Cv4R�+�"H)4R!9#��)>+V7�)#�';�5#�!vJ,4R!$\n�q|}#�!I% H):�:�!$: � tLH)��(IHO�$:���4sC�3x';>+�"��=;>+4/>�4r8&��(R:�>n(R:B�$4Ri,#�!$�+4sC���CLC"H;#BtL��\Y4R>�#Bt/�

�����&�� �� �G&� � �� �) ����& �������� ����� ���������� �&�� �)� �������������#�� � �� %$�$ ������� ���& � $2�� ��������� �����$�� ��& � �������������&#���&�� �� �Z��"��& ������ � ��&�� ��� � ���������� � �

�G&� � �� �) ����& �������� ����� ���������� �&�� �)� �������������#�� � �� %$�$ ������� ���& � $2�� ��������� �����$�� ��& �)# ����& ���#���&�� �� �Z��"��& ������ � ��&�� ��� �

�G&� � �� �) ����& �������� ����� ���������� �&�� �Z7���&������� ���& � $2�� ��������� � � ����$ ���"��� �����$�� ��& � �������������& � #�����& ���#���&�� �� � � ��&��� � �� �� �� � ��"��& ���%$ ��� �

�G&� � �� �) ����& �������� ����� ���������� �&�� �Z7���&����������� ������������ ���& � ����$ ���"��� �����$�� ��& � �������������&#���&�� �� �Z��"��& ������ � ��&�� ��� � ���������� ���

Page 36: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

EB� ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� � $ �%$ �%$ � d>jlA3]�� d\Bqm���BEdTh/_ LcB�� � ����

��H;4KQ ';�)(r�"��#��}#<Q[�$H;��C.\;>+#&( ����CG�"#OQ #�!$3 �"H;45tP#�!I%�i�!$#�')=)C@#,�-�$H;4K\):�C"��C0#�Q �"H)4 >+#&(R:�>��+�;Q #�!$35:<�"��#�� �n~�� � 4/���&Q #�!$3D:B�"��#��O\):,CU4s% #,�O:,% aU:�(R4R� �Lt�#,!$%;CI�*�?h� 4R8&:�35=;>+4.��>+>�')CU�"!I:B�$4ACP�"H)4�ab#�\ %&#��;4/\2VD�$H;47p,|�cK�;�����"H)47CU4A�,�$4R�)(R4��

����������� ����������#��������" !�����& � #������� ���5& �� �� � � ��(�� ��� ����� �� ��& ��" � ��& ����� +����& ����� ������*� �� 1��&��6����& ����� ������ �� �6����� �����&8( ,

�"H)4G#,'&�"=;';��(R#�!$!"4sCU=Y#��)%;�+�;i.�$#7�$H;4GtP#�!I% F:�%&H2V,:,:<=):��B: ��:��)% ��# ��Q !"#,3 �"H;4035#�! �=;H;#,>+#,i���(R:�> :��):<>�V&CU��Cq\)>+#&( �7tL��>+>2\Y4�i�!$#�';=Y4A%x:�CT#��;4�';�)���9\2V.�"H;4Lp,|�c �<C"��3K��>�:<!$>+V�� =):<H):��):�: � � !$:�H;4 �;:��)% H)4R��_ �;tL��>+>n:�>�C"#KQ #�!$3{:5CU���;i�>�4.';�;�+�A���H;4 )�M:<>n#,'&�"=;';�hQ #�!��$H;47tP#�!I% i,!"#,';=)C�\Y4R>�#BtdQ !$#�3{�"H;47p,|�c�tL��>+>�:<=;=Y4A:�!:�C

/� �& 5��& ���#� � ���������1 �����#����� ����� ������� � � �K�� ���� ���&� ���# � � ���������"���

�� ���� ���& ���# � ������ ���& �>$2�� ��������� ��� ���� ���& ���# � �����$�� ��& �Z# ����& ����� ���� ���& ���# � �# ��&�� �� � ��"��& �� ���� ���& ���# � �#���&����&�� � � �

~ �@#<�$4 �$H):B�.�"H)4x#,\;>+��� ';4K#�=&�$�+#,�]#<Q[�$H;4Kt�#,!$% >�:�0:���4��MHM:�C0\M4A4R� !"4Uab4A(*�$4A% ��\Y4 �(R:�')C"4G�$H;4R!$4.��Ch�;#5=M# Cb� � =Y#,C"���$�+#,��#,! � ���� �� � Q #,>+>�#BtL���;i >�:�0:��,4 ��� �� ����� ����#����"�6�" �� �� �K�� ���� ���& ���# � � ����� ����#����"�

�� ���� ���& ���# �������� ���& �>$2�� ��������� ��� ���� ���& ���# �������$�� ��& � �������������&�� ���� ���& ���# ���# ��&�� �� � ��"��& �� ���� ���& ���# ���#���&����&�� � �� �

�K�����& ��� �� �K�� ���� ���& ���# �� �Z ����& ��� ���� ���& ���# �� ������ ���& �>$2�� ��������� ��� ���� ���& ���# �� �����$�� ��& � �������������&�� ���� ���& ���# �� �# ��&�� �� � ��"��& �� ���� ���& ���# �� �#���&����&�� � � �

�K#��� �������5& �� �6 � � � �� �G7���&�� �&� � �� �Z# ����������7���&�� ��� �&�$ � ���& �������� � �7���&�� ������ ���& �>$2�� ��������� �7���&�� �����$�� ��& �Z# ����& ���7���&�� �#���&�� �� � ��"��& 7���&�� �����&�����$"����� �)����&�� � �

XG�;>�V��"H)#,C"4Di�!$#�';=;���;i C/:<!$45%;#��;4D\2V p,|lc �nH;#BtP4RJ�4A!���tLH)��(IH tL��>+> �;4R4s% �)#!$4RJ2��C"��#�� >�:B�$4R!L#,�n� ��H;��CL�+35=;>���4ACP�"HM:B�htLH;4A�;4RJ,4R!��"H)4R!$40��Ch:K=Y#,C$CU��\;��>+�+�bV�#<Qv35#�!$4�"HM:<��#,�;4hi�!$#�')=;�+�)i.Q #�!�C"#�354htP#�!I% ���"H;4AVKtL��>�>M�;#�� \Y4@i�!$#�')=M4s%K�"#�i,4r�$H;4R![\2VK�"H)4p,|�cK� f #,!@4r8;:�3K=)>+4��)\Y4A(R:�')C"47#<Q9�$H;47�btP#�!$4A:�%;�+�;i CL#<Q9�$H;4 tP#�!I% =M:<!I: �)#,�;4 :,C=):�!$C$:<!$i@#,!T=Y#,CU�"=Y#,C"�+�"��#��5:<�)% �"H;4�#��"H;4A![:�C9:G�;#�';� ���+�vtL��>�>&�;#<�[\Y4�i�!$#�';=Y4A%xtL���$H 3K#,!$: �&�+�O4R�+�"H)4R!h#�Qq�"H)47CU4A�,�$4R�)(R4AC�\Y4R>�#Bt �

Page 37: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �����!�� � � � � � � ��� ��� � � ��� � ���������� ���� � � ��;� E,�

$ �& � #���&�� #� � ���������"��& � ����� ��� & ������ � � (# ��� �� ��� �������� ��&�� ��7������ ��#�&����� ��� ��� ���������*�� ��7 ����� �#�&����� ������������� ��&� ����6# ��� �� ��� �� ��� �������8( ,

������&�� $ �& � #���&�� ��������������� ��#���& ����� �6 � � (��&�& �/+# ��� �� ��� � �� ����&�� ��&��F$2� ��* 4 � ��5� ��& �@$2�1� ����7��+��� ��&�& �/ ��+����6# ��� �� ��� ( ,

��H;��C.\;>�#2( � H):�C.\Y4R4A� �+� �$!"#&%&')(R4A%-�"#�!$4A%&'M(r4K�"H;4 >+# :�% #��}�"H;4�(R#�!$45=):<!ICU4A!!$4AC"';>��$�+�)iK��� �+�M(r!$4A:�C"4A% 4 ��(r��4R�M(rV�:��)%OCU��35=;>+��(r�+�bV #�Qq�$H;4/#BJ�4A!$:�>+>�C"V2CU�"4A3 �

$ �%$ ��� O�d\BEL �gAGB�=sLcB��H;4LQ ')�)(*�$�+#,�D#<Qz�"H;4G(r#�!$4L=):�!$C"4R!9��C9�$#7:�(R(R4R=&� �"H;4h>�#&(R:�>;t�#,!$%Ki,!"#,';=)Cv=;!$#&%&')(r4s%\2V�p�|lc ��:<�)%-=;!"#&%&'M(r47�$H;4K=):<!ICU4KCb�$!"'M(*�"')!"4,� ��H)4x=):�!$C"4 CU�"!$')(*�$';!$4 =;!$#&%&')(r4s%\2V �+�@��ChCUH)#BtL�O:<�h�"H;4/\Y4Ri,�+�)�;�+�)i�#<QT�"H;��ChC"4A(r�"��#��n�P_]:<���;>�V �;�+�@��%&4R� �"� )4sC �B:<!I:��B:!$4R>�:B�"��#��MC�\Y4r�btP4R4A�O�"H;4/J,4R!$\)C�:<�)%��"H)4/�;#�';�MCR���H;4D(r#,!"45=):�!$C"4R!03D:��,4AC.')C"45#<QP�"H;4D��%&4A:,C.#<Q� :,:��B:�:�� �&CUH):,: :��)%-V,#�i,V,:B�I:�:

�/~�%&4A3D:<�)% :<�)%d3K4A!"�+�I��Q !$#�3 Z9:<�)�+�;��:<�dc0!I:<353D:<!s� 12#�354 t�#,!$%;C}~ #,!�tP#�!I%i�!$#�')=)C$�Y3D:���4 %&4A3D:<�)%;C�:<�)%.#��"H;4A!$CqC":<�"��CbQ VG�"H;4A3 � f #�!q4R8;:<35=;>�4 �sJ�4R!$\)C[~�#�!�J�4R!$\i�!$#�')=)C$� 3D:��,40%&4A3D:<�)%;CPQ #,!��"H;4A�+!��B:�!$:�� :,C �2:<�M%��bV2=;��(R:�>+>�V5�"H;4/�)#�';�)C/~�#�!��;#,';�i�!$#�')=)C$�0C$:B�$��CUQ V]�$H;4R3 � Sh#BtP4RJ�4A!��q#��;>�V-(r4A!U�I:<�����;#�';�MC.�"H):<� H): J,4x�$H;4 %&4sCU��!$4A%=):�!$C$:<!$i-:<�M% C"4R3D:<� �$��(�=;!$#�=Y4R!"�"��4AC5:<!$4�4A>+��i���>�\;>+4,� ��H;��C5��CD(R:<>�>�4A% � � �} � #,!354R!$���h#�Qq�$H;4/�;#�')�)CR�

NP4AC"��%;4AC��$H;4�:<\Y#BJ�4 �A�"H)4R!$4 ��C�:��;#<�$H;4R!��+35=Y#�!"�$:<� �T�;#<�$�+#,� � FC":��;�;��%&H;� �A#,!q�;4s:<! ��;4sC"CA� ��H;��C/CU=Y4A(R�� )4sCG�"H;4K!"4A>�:<�"��#��)CG\Y4r�btP4R4R� �btP#�(r#,�)CU�"�+�"';4A�,�IC0tLH;4R� �"H;4AV]:<!$4(r>�#,C"40�"#54A:,(IH�#��"H;4A!L�+�O�$H;47CU4A� �"4R�M(r4��

?@:��B:�:<� �2C"H):,: �RV,#�i,V,:B�I:�:�:<�M%7C":��;�;��%;%&H;�,Q !$#�3�Z�c H): J,49\M4A4R� 'MCU4s%/�+� \;';��>�% ����;iD:KQ�:�CU��=M:<!ICU4A!PtLH)��(IH tL��>+>�\Y47%&4AC$(r!$��\M4s%����-��H):<=q�v^)�

� ��� � ,����('*.1, ,o%w5G0 ������� 2 �|5G# 51' �8%g#�� ��.1#��� # .10

��#x:<=)=;!"4s(r��:B�$4L�"H;4G=;!$#�=Y4R!"�"��4AC[!$4A� ';��!$4A%D#�Qq(r#�35=;';�$:B�$�+#,�):<>Mi�!I:<353D:<!IC �,���P��C���3 �=Y#�!"�$:<� �9�$# )!$CU�[';�)%;4R!ICb�I:<�)%x�"H)4L�;4R4s%;C[#�QY�):<�"';!I:<>&>�:<�)i�'):�i�4�=;!$#2(R4AC$CU���;iD~ �GpqZP�C"V2CU�"4A3DC.tLH;��(IH}H): J,4x\Y4R4A�}\)';�+>+�/Q #�!7%;�+J,4R!ICU45:<=;=)>+��(R:<�"��#��)CA� f #�!/4R8&:�35=;>+4����"H)4:<=)=;>+��(R:<�"��#��)C =M4A!U�I:<���D�"#x!"4R�"!$�+4AJ2�+�;ix%;:B�I:7����!"4sCU=Y#��MCU4L�$#x: ')CU4A!�!$4A� ';4sCb���+���M:B� �';!I:<>h>�:<�)i�'):�i�4 ��:<�MCUtP4R!$�+�)i �,')4ACU�"��#��)CD=Y4R!"�$:��+�)�+�;i �"# : %&#,3D:<��� #�Q/4r8&=M4A!U�$��C"4 �Q #�>�>�#BtL�+�;i �+�MCb�$!"')(r�"��#��)CK��� �M:B�"')!$:�>P>�:<�)i�'):�i�4 �93D:,(IH;�+�)4 �$!$:��)CU>�:B�$�+#,� Q !$#�3 #��)4�):<�"';!I:<>v>�:<�;i,'):<i,47�"#�:��;#<�$H;4R! �n:<�)%}C"#�#,�n�K?@� �GpqZ�C"V2CU�"4A3 3 'MCb�7%&#O#��;45#,!\Y#<�"H #<Qz�bt�#.�I:�C �&C �����P3 ')CU��:<�M:<>�V wA4��"H;4@i���J�4R�D�M:B�"')!$:�>;>�:��;i�'M:<i�4�'&�"�"4A!$:��)(r4��,#,!i�4A�;4R!I:B�$4G�M:B�"')!$:�>�>�:��;i�'):�i�4G�"4R8 �LQ !$#�3 �"H;4/i,�+J,4R� (r#�� �$4R� �A�

Page 38: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

E<^ ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� � ?h� �@p�Z C"V&Cb�$4R3 (r#,�)CU��CU�$C0#<Q�: i�!I:<353D:<!0:<�)%-i�i�=)!"#&(r4s%&';!I:<>T(r#�35=Y#��;4A� �$CA�

��H;4�i�!I:<353D:<!T��Cv')CU4s%7\2V/�$H;4�=;!"#&(R4A%&';!I:<>&(R#�35=M#,�;4R� �IC����K=M4A!UQ #,!"35���;i0:��):<>�V&CU��C��i�4A�;4R!I:B�$�+#,� �n4R�$(<� f #,!74r8;:<35=;>�4 �T:�� ';4ACU�"��#�����:<�MCUtP4R!$�+�)iOC"V&Cb�$4R3 tP#�')>�%�(r#,�)C"��CU�#<Q�:�C"4r�/#�Q�=;!$#�i,!$:�35Cx~ =;!$#&(r4s%&';!I:<>9(r#,3K=Y#��)4R� �I�0:<�M%-:�i�!I:<353D:<!GQ #�!0�"H;4D>�:<� �i�'M:<i�47(R#��)(R4R!$�;4A%n� ��H)47=;!$#�i�!I:<3DC�tP#�';>�%�:<�M:<>�V wA47:Di���J�4A�]� ';4ACU�"��#���')C"���;iD�"H)4i�!I:<353D:<!K:<�)% !"4A=;!$4AC"4R� � �$H;4�354s:<�;���;i�:<=;=;!$#�=)!"��:B�$4R>�V���?�!$4A:,CU#,�;���;i-(r#,35=M# ��;4A�,�G=;!"#&%&'M(r4AC@:5!"4A=;!"4sCU4A� �$:B�$�+#,��#�Qv�"H;4 :��)C"t�4A!A� f ���):<>�>�V �M:��;#<�$H;4R!@=):<!"�h#<Qv�"H)4=;!$#&(r4A%;';!$:�>M(R#�35=M#,�;4R� �P=;>�:��)C�tLH):B�P��C �"#x\M40C":���%�:��)%5�$H;4R��')CU4sC[�$H;4@i,!$:�3535:�!���Oi,4R�;4A!$:<�"���;i5:x!$4AC"=Y#��)C"4.�+��:K�):B�$';!I:<>�>�:<�;i,'):<i,4��

$ ��� ��� O�dTab_`h>FQAGFEHkdTJoA1]8:�=W_ Lcj«F��H;��CL=;>�:�(R4ACh:5�;4At�!"4s�,')�+!$4R354R� �L#�� �$H;4/i�!I:<353D:<! �&�):�3K4A>+V��;�$H):B�@�+�@C"H;#�';>�% \Y4C"';���I:<\;>�4/Q #,!@=;!$#&(r4AC$C"�+�;i5\2V��"H;4x=;!"#&(R4A%&';!I:<>�(r#�35=Y#��;4A� �A�L?h�]��35=M#,!U�I:<� �G(R!"�+�"4�!$�+#,�xQ #,!�ab')%&i,�+�)i CU')���I:<\;��>+�+�bVK��C9H)#Bt 4 �D(R�+4A� �">�Vx�+��(R:��D\M4@')CU4s%5�+�D=)!"#&(r4sC"C"���;i)�T?i�!I:<353D:<!@Q #�!$3D:<>���C"3 t�#,';>�%�\M4D(R#��)C"��%;4R!$4A%]C"';=Y4R!$�+#,!@�$#O:��;#<�$H;4R!.�+Q i�!I:<353D:<!ICtL!$���"�"4R� �����+�@(R:���\Y4/')C"4A% Q #�!L=;!$#&(r4sC"C"�+�)i Q�:,Cb�$4R!L#�!�tL�+�"H >�4AC$CU4A!h(r#�35=;';�"���;i5!"4�C"#�';!I(r4sC[4r�I(<�[c0!I:<353D:<!�Q #�!$35:�>+��C"35C[�"H):<�PHM: J�4h\Y4R4A��%&4sCU��i��;4s%DtL�+�"HO=;!"#&(R4AC$CU���;i��� 35���)%�:<!$4�(R:<>�>�4A% ����� � �Q} �}�{���� � � � ��w� �� �*����� � { ���8� #,!�(r#,3K=)'&�$:<�"��#��):�>i�!I:<353D:<!535#&%&4R>�CA� ? i,!$:�3K3D:�!KtL!$�+�U�"4A�l�+�lC"')(IHl:�35#2%;4R>htL��>+>G\M4 (R:<>�>�4A% :(r#,35=;'&�$:<�"��#��):�>�i�!I:<353D:<!s�

$ ��� �%$ Y6R/= FQLca�= :�=s_ L j«F12V&CU�"4R3 \;';��>�%&���;i.H):,C��+�$Cv#BtL�K!$4A� ';��!"4A3K4A� �$C��stLH)��(IH5: �z4A(r�9:�35#��;i0#<�$H;4R!T�"H)�+�;i C ��"H)4[�"H)4R#�!$V.')C"4A%/���7\;';��>�%&�+�)ih�"H)4R3 � f ��!$CU���<:ht�#,! �2���;i@C"V2CU�"4A3 !$4A� ';��!$4ACq(R#�35=;>�4r�$4%&4R�$:<��> �@�;#��"H;���;i (A:<� \M4}tP:��+J,4A%�#,!�tL��CUH)4A%d: t�: V�� ��H;��C�C"4R!$J�4sCD�"# �"4sCb�O�"H)4�"H)4R#�!$V.�"H)#�!$#�';i,H;>+V/\Y4A(A:<')C"4�%&� ��(R';>��[=)!"#,\;>+4A3DCTC"#�354R�"��3K4sCv!"4A>+4Ai,:<�"4A%/�"#/%&4r�I:<��>�C(r#,�&Q !$#�� �L')CLtLH;4A�OtP40�"!$V��$#K\)';�+>�%�:5CUV&CU�"4A3O� 1&#�354/4r8;:<35=;>�4AC�#�QvC"')(IH %&4r�I:<��>�C#<Q �$4R�O>+4RQ �P')�)CU=Y4A(R�� M4A%��+�O>+���;i,';��CU�"��(@�"H;4A#�!$�+4sC�:�!"4.(IH;#���(r4G#<QnQ 4s:B�$';!"4sC �&:K%&4r�I:<��>+4s%>�4r8&��(R#�� �;:��)%Ot�#,!">�% �2�;#BtL>�4A%;i�4��

? C"V&Cb�$4R3 Q #�!I(r4sC/')C �"#-%&4s:<>PtL���$H =;!$#�\;>�4R3DC tLH;��(IH 35��i�H �xHM: J�4D\Y4R4R� CU4R�:�C"��%&4L\2V7�"H)4 )4R>�%x�"#7\Y4@%&4s:<>+�[tL���$HD>�:<�"4A!A� f #,!94r8;:<35=;>�4 � :/CUV&CU�"4R3�Q #�![� ';4sCb�$�+#,�:<�MCUtP4R!$�+�)i tL��>+>nHM: J�4G�"#D%&4A:�>�tL���$H�=)!$:�i�3D:B�$��(AC �2�+�@(R:<�)�;#<�h(IH;#2#,C"4G�"#D%&4A:�>�tL���$HC"V � �I:B8]#�!/C"4R3D:<� �$��(AC@#,�;>+V,�K12��35�+>�:<!$>�V �qC"')(IH :OC"V2CU�"4A3 3D: V�\M4KQ #,!$(R4A%��$#O%;4A:<>tL�+�"H CU4A�,�$4R�)(R4/:�CPt�4A>+>�:,CP%;��C$(r#,';!$C"4��[��!$#,C$CU���;i7�$H;4.>+4AJ�4A>Y\Y#�')�)%;:<!$��4AC�:<�)%O%&4s:<> ����;i�tL�+�"H�H;�+�"H)4R!"�"#O�+i,�;#�!$4A%-=;!"#,\;>�4R3DC@=)!"#&%&')(R4AC0�;4At t�: V2CG#<Q�CU4Ai�354R� �$�+�;i��"H)4=;!$#�\;>�4R3 � ?P�.�$�+354AC��n�+�/=;!"#&%&'M(r4AC.:,%]H;#&(KCU#,>+'&�$�+#,�)CA� ��H;4RV :<!$4x:<>�>v=;!$4A(r')!$C"#�!IC�"#D:5�;4Atu�$H;4R#,!"V,�

XG�}�"H;4 #<�"H)4R!/H):��)% ���"H;4A!"4 :�!"45#&(R(A:�C"�+#,�)C.tLH;4A��:]t�4A>+> � %;4RJ�4A>+#,=M4s%]�$H;4R#,!"V��C/\2V =M:�C$CU4s% ��� :�CUV&CU�"4A3 \Y4A(R:�')C"45�"H;4�=)H;4R�;#,354R�;#,�}\Y4R���;i]4R8&=;>�:��+�)4A%}\2V]�"H)4�"H)4R#�!$V ��C �;#<� #�Q/3 ')(IHl��� �"4R!$4ACU�A� f #�!�4R8;:<35=;>�4 �L35#,CU� 3D:�(IH;���;4��$!$:��)C">�:<�"��#��C"V2CU�"4A3DC[:�%&#,=&� :/C"�+35=;>�4h35#&%&4R>)Q #�![35#�!$=;H;#,>+#,i�V.Q #,![!"4s:�C"#��)Cv#�QMQ�:,Cb��=;!"#&(R4AC$CU���;i

Page 39: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �����!�� � � � � � � ��� ��� � � ��� � ���������� ���� � � ��;� E e:<�M% \Y4A(A:<')C"47%&4R!$��J :<�"��#��O#<QTt�#,!$%;C�Q !$#�3�3K#,!"=)H;4R354ACP��CL�;#��hJ�4R!$VD��3K=Y#�!"�$:�� �A���H;4���y ��E�y]!$';>�4 :�>�C"#�(r#�354sCx��� �"#}�"H)4�=;��(r�"';!$4 tLH;4R� #��)4��$!"��4ACx�$# H): J�4O:

�U!$4A:,CU#,�):<\)>+4 i�!I:<353D:<!7Q #,!K: CUV&CU�"4A3O� ��H;��CK!"')>+4OCb�I:B�"4sCx�"H):<�DE�y]=Y4R!I(r4R� �K#<Q�"H)4]i�!I:<353D:<!�(R#BJ�4R!IC5��y�=Y4R!I(r4A�,��#<Q0�"H;4 >�:��;i�'):�i�4,�u|lH;4R�l#,�;4-CU�$:�!U�ICDtL���$H:}i�!I:<353D:<!KQ #�!��,y-=Y4R!I(r4A� ��>�:��;i�'):�i�4 :<�)% �"!$��4ACK�"# (R#BJ�4A! �$H;4�!"4A3D:<���;�+�)i E�y=Y4R!I(r4R� �5#<Qh>�:<�;i,'):<i,4 �9:}CU4AJ�4R!I:<>[Q #�>�% ���)(r!$4A:,CU4��+� i�!I:<353D:<! C"�+wA4 �I:��,4AC7=)>�:,(r4����H;��C@HM:<=;=Y4R�)CGtL�+�"H��$H;4x\Y4ACU�G#�Q9�"H;4A#�!$�+4sCR�@� �G��CG:D!$4R35���)%&4A!@�$H):B�G�"H;4xt�#,!">�% ��C�;#��@:�C�#�!I%&4A!"4s% :�CP�$H;4.�"H)4R#�!$��4ACPt�#,';>�%�>�� ��4.���L�$#5\M4,�

$ ��� ��� � A3BE[\LbYSR/=sFQLca :�=W_ Lcj«F|lH;4A�]�"H)4KC"V&Cb�$4R3 \Y4R���;i \;')�+>+�/��CG>�:�!"i,4 :<�M%-(r#,35=;>+4R8 �z:,C@35# Cb� �@pqZ C"V2CU�"4A3DC:<!$4 �&�+�hH):,C��+35=;>���(A:B�$�+#,�)CPQ #�!��$H;4R#,!"V :,C�t�4A>+>n:,C�354r�"H)#2%;#�>�#�i�V,�

� � ��� � ���{~} ��CO: %&4sCU��!$:�\;>�4-=;!$#�=Y4R!"�bV #�Q >�:<!$i�4-C"V&Cb�$4R3DCR� � � �+35=;>��+4sC��"H):<��"H)4 C"V&Cb�$4R3 (A:<� \M4]%&��J2��%;4A% �+� �"# C"4RJ,4R!I:<>P=):<!"�$CK��� C"')(IH�:-3D:<�)�;4R!5�$H):B�5�"H)4���,�$4R!I:�(r�"��#�� \M4R�bt�4A4R� =):<!"�$C5��CD35�+�)�+3D:<>G:<�)% (r>�4A:�!">�V C"=M4s(r� )4A%�� ��H)��CD��C5J�4A!"V��3K=Y#�!"�$:�� ����Q #,!/4r8;:<35=;>�4 �ntLH)4R��>�:�!"i,4x�2';3x\M4A!$C.#�Q�=Y4R#,=;>+45H): J,4K�"# t�#,! �]:,C.:�"4s:<3��+��%&4AJ�4R>�#�=)�+�;ix�"H)4 CUV&CU�"4A3O� ��H)40��35=;>���(A:B�"��#��OQ #,!��"H;47i,!$:�3535:�!�35#&%&4A>n��C�"HM:B�[�+� CUH;#,';>�% \Y4hCU'M(IH �$H):B� C"4RJ,4R!I:<>2=M4A#�=;>�4h(R:��xtP#�! �7(r#2#,=M4A!$:<�"��J�4R>�V/���xtL!$���$�+�)i:Ki�!I:<353D:<!�')C"�+�)ix�$H;4/35#&%&4R> ~�#�!�Q !I:<354RtP#�! �;�*�

� �s} �*�q��{���{ � {~} ��C #��;4L#�QY�$H;4h35#,CU� ��35=M#,!U�I:<� � %&4AC"��!$:�\;>+4L=)!"#,=M4A!U�$�+4sCv#<Qn:/>�:<!$i�4C"V2CU�"4A3 �G� �03K4s:<�)C@�"HM:B�0�"H;45CUV&CU�"4A3 (A:<�]\Y4 4R82�"4R�M%&4A%-#�!G(IHM:<�;i,4A%�\;�+�G\2V \;�+�A���H;4A!"4D:<!$4x�bt�#O!"4s:�C"#��)C@Q #�!.�$H;��CR� f �+!ICU���q:O>�:<!$i�4K!"4s:<> � >���Q 45C"V2CU�"4A3 H):,C0�"#���4A4R=(IH):��;i����;i��"#0C":<�"��CbQ V/(IH):��;i����;iL!$4A� ';��!"4A354R� �$CA�n� ��tL��>�> C"#2#��7\Y4A(R#�354[')C"4R>�4AC$Cn�+Q;�"H)4C"V2CU�"4A3 (R:<�)�;#<�.\M4K35#&%&�� M4A%��7124s(r#��M% �n:<�)%]3K#,!"4x�+35=Y#�!"�$:��,�$>+V��z>�:�!"i,4xC"V2CU�"4A3DC:<!$4@�)#<��\;';��>��L:�C )�;��CUH)4A%OCUV&CU�"4R3DC��+��#��;40CUH)#<�A� ��H)4RVD:<!$4@\;')�+>+�L�+�OCb�I:<i�4sC9Q !$#�3C"�+35=;>�4[�$#G(r#,35=;>+4R8��T12')(IHx:h=;H):,CU4s%7(r#,�)CU�"!$')(*�$�+#,�/��C�=M# C"C"��\;>+4�#��;>�V0��Q;�$H;4�C"V&Cb�$4R3\;';��>+�h�+� 4A:,(IH�=)H):�C"4.��CL4R82�"4R�MCU��\;>�4��

6982�$4R�)C"�+\)�+>����bV�:�=;=;>��+4s%��$#5i�!I:<353D:<!IC 354A:��)C��"H):<�LtLH;4R�O�"H)40>�4r8&��(r#,� ��CL:<';i �354R� �"4s%D#�!�:7�;4At >�:<�)i�'):�i�4L=;H;4A�;#�354A�;#��D��C�C"#�')i�H �9�"#x\M40(r#BJ�4A!"4s% �<�+�P%&#24sC[�;#��>�4A:�% �"#D4R82�"4R�MCU��J�4.!$4RtL!$���$�+�;iK#<QT�"H)4/i�!I:<353D:<!s�

? CUV&CU�"4R3 tL��>�>��+�2JB:<!$��:�\;>�VK\Y40Q�:�(R4A%�tL�+�"H C"���$'):B�$�+#,�)CP�+��tLH;��(IH����LtL��>+>zQ�:��+>Y�$#=Y4R!"Q #�!$3 �$H;4h�I:�C �2C ���PH):�C \M4A4R�O%&4AC"�+i,�;4A%KQ #,!A��� � � {~��� � {~}~�`� �{ � �Q� ��� �2�$H;4R!$4rQ #,!"4��3 'MCb�@\Y4 =M:<!"�@#<Q[C"V2CU�"4A3 %;4AC"�+i,�n����H;4R!$4 :<!$47C"4RJ�4A!$:�>n:�C"=M4s(*�ICL�"#��"H;��C@=)!"#,\;>+4A3 �|lH;4A� :hC"V2CU�"4A3 %;4r�"4s(*�ICn�$H):B�T���v(R:<�)�;#<��%;4A:<>,tL���$H/�"H)4 �):<�"';!I:<>,>�:��;i�'):�i�49!$4R>�:B�$4A%�$:,C � �z�+�03x')Cb�/(r#,353 ';�;��(R:<�"4x���0�"# �"H;4K')C"4R!s� ��H)4x')C"4R!.(R:����"H)4R�-!$4R=)H;!$:,CU4 H;��C!$4A� ';4ACU�[����:<�;#��"H;4A!935:��;�;4A![tLH;��(IH5�"H;4hC"V&Cb�$4R3 3K��i�H �[\Y4@:<\)>+4��$#7H):<�M%&>+4,�v1&')(IH(r#,353 ';�;��(R:<�"��#��u:�>�C"# C"4R!$J�4sC5�"# 4A%&')(A:B�$4]�"H)4 ')C"4R!O:<\Y#�'&���"H;4}>��+35�+�$:B�$�+#,�)C�#<Q�"H)4OC"V&Cb�$4R3 �[CU#]�"H):<�K��� Q '&�$';!$4 �9H;4O35�+i,H,�K>+4s:<!$���"#�: J�#,��% �"H)4R3 � ��H;4 >�:B�"�"4R!��3K=)>+��4AC@�"H):<�hQ #�!@�"H;4KCUV&CU�"4A3{�$# :<=;=Y4A:�!LQ !$�+4A�)%&>�V �Y���03K��i�H �@\Y4 \Y4r�"�"4A!h�"#O: J�#,��%H):��)%&>��+�;i��$H;#,C"4[�):<�"';!I:<>B>�:<�)i�'):�i�4v=;H;4A�;#�354R�M:�Q #�!ntLH)��(IH0�"H)4R!$4 :<!$4v�;#@:�%;4A� '):B�$4C"#�>�'&�"��#��)CA��X@�$H;4R!$tL��CU4��+�xtL��>�>P\Y4�%;� ��(r')>��KQ #�! �"H;4O')C"4R!7�$# �,4R4R= �"!I:�( �}#<QL�"H)4>��+35�+�$:B�$�+#,�)CA�

Page 40: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

E<� ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� � ��H;4 C"V&Cb�$4R3 3 'MCb�.:<>�CU#�=)!"#BJ2��%&4 C"'���(r��4R� � � � � � � � � �"# �"H;4KCUV&CU�"4R3 %&4sCU��i�� �4R!IC@~�tLH;��(IH��+�M(r>�')%&4AC �"H)4Gi,!$:�3K3D:�![tL!"�+�"4A!$CI�v!$4Ri :<!I%&�+�)i/���IC[Q�:��+>�';!$4ACA��� ��(R:<� H;4R>�=

�"H)4R3�%;4r�"4s(*� =)!"#,\;>+4A3DCv�+�K�"H)4R��![%&4AC"�+i,��~ ���K=)!"#&(r4s%&';!$4ACv#,!9i�!I:<353D:<!IC$�q:<�)%x�"H2')CH;4A>+= ;8��"H;4A3 ~�#�!@%;4R\;';i5�$H;4R3�� �M�+QT=Y#,C$C"�+\;>�4��P698&=Y4R!$�+4A�)(r4/tL�+�"H�\;')�+>�%&���;i�>�:<!$i�4C"V2CU�"4A3DC[���)%&��(R:B�$4AC[�"H):<� ���¤����� � {~��� ��C :<� �+35=Y#�!"�$:<� ��:,(*�$�+J2�+�bVx\Y#<�$H�tLH;��>+4G\;';��>�% ����;i��$H;4KC"V&Cb�$4R3 :��)%]:BQ �$4R!0���/CU�$:<!"�$CGi�4R�U�$�+�;i�')C"4A%�����H;��C@��35=;>��+4sC@Q #,!Gi,!$:�3535:�!:<�M% i,!$:�3K3D:�! tL!$���$�+�;i �2�"H):<���"H;4.i�!I:<353D:<!�C"H;#�';>�%�\M4/C"#K%&4sCU��i��)4A%D�$H):B�L4A!"!$#�!IC:<�M%-=;!$#�\)>+4A35C.(A:<�}\M4D��%&4R� �$�� )4s%-4s:�C"�+>�V��D12=Y4A(R��:�>+��wR4s%-=;!$#�i,!$:�353K���;i �"#2#�>�C/:<!$4')C"'):<>�>�V��;4A(R4AC$C":�!"V5�$#D:�C$CU��Cb�L����%&4R\;')i�i����;iM�� � � ����� � ��� � � �� �}�{���� ��C :<�;#��"H;4A!-%&4AC"��!$:�\;>+4�=;!$#�=Y4R!"�bVd#�QK>�:<!$i�4 C"V&Cb�$4R3DCA�

|lH;4A�d�$H;4 'MCU4A!O!$4A� ';4sCb�IC��I:�C �&C��$H):B��:<=;=)!"# :�(IH��"H)4}>���3K�+�$CO#�Q �"H)4}(A:<=):�\;�+>�� ��"��4ACh#<Qq�$H;47C"V2CU�"4A3 �2�"H;47%&4R�"4A!"��#�!I:B�$�+#,� ��� C"V&Cb�$4R3 !$4AC"=Y#��)C"4/CUH;#,';>�% \Y47CU>�#Bt/�v���#<�$H;4R!@t�#,!$%;C��;tLH;4A�]:5!"4s� ';4ACU�@��CLi���J�4A���$H):B�@�"H;4 C"V&Cb�$4R3 (R:��;�;#<�hHM:<�)%&>�47=;!$#�= �4R!$>�V ���+��3x')CU��Cb�$�+>�>Y!"4sCU=Y#��)%5tL�+�"HD=M:<!"�"��:<>)���&Q #,!"3D:B�$�+#,� �,:��)%5tLH;4A��35#�!$4h%&� ��(R';>��!$4A� ';4ACU�$CL:�!"403D:�%&4��&�"H)47:<�)C"t�4A!�i�4r�IC�=;!$#�i�!$4AC$C"�+J,4R>�VKtP#�!IC"4��f �+�M:<>�>+V��[�"H)4 C"V&Cb�$4R3 C"H;#,';>�% \Y4 }P� � �*� ��q}©�k� �@��*� �*���´����� � ��� �$H;4�(R:�C"4O#<Q�):<�"';!I:<><>�:<�)i�';i,49�+� �"4A!UQ�:,(r4sC9~ tLH;4A!"4[�M:B�"')!$:�><>�:��;i�'M:<i�4v��Cn\Y4R���;ih')C"4A%G�$#LQ�:�(R�+>����I:B�$4(r#,353 ';�;��(R:<�"��#���tL�+�"H �"H;4.(r#,35=;'&�"4A!I� �&CU')(IH 4R!$!"#,!$C 3K��i�H �P=M4A!U�I:<�����"#KCU=Y4R>�>��+�;i C �C"4R� �"4A�)(r4}(r#��MCb�$!"')(r�"��#��)C��@:�i�!$4R4R354A�,��!$';>�4AC��h4r�I(<�{��#�!$!$4A(*�$�+#,�l\2V �$H;4 C"V&Cb�$4R3C"H;#�';>�%O\M4/��35=;>���(R���@tL�+�"H)#�'&�h=;!$#�35=&�$�+�)iD���L�$#5�"H;47'MCU4A!A��X@�$H;4R!��2���)%;CL#�QT4A!"!$#�!IC=Y4R!"�$:<���;���;i7�$# 35��C"(R#��)(R4R=&�$�+#,�)C[#,';i�H �[�$# \Y40%&4R�"4s(*�"4s%�:<�M%�(r#,!"!$4A(r�"4A%54R8&=;>+��(r�+�">�V��

� hoBQFE?/LMB U LMA1moHpJo[gL4s�,')�+!$4R354R� �IC�#<Q (R#�35=;'&�I:B�"��#��M:<> i,!$:�3535:�!��+� 124A(�� E&� Wu:<!$4 \):�C"4A%�#,�

NPH):<!I:B�$�z4r�@:<> �h~b�s��� E<:,�r�n �>LMBqjNHp=WLc=

k � � 12H;#Bt��$H;4@35#&%&� )4R! � 3K#&%&� )4s%DCb�$!"')(r�"';!$4hQ #,![�$H;4GC"4R� �"4A�)(r4sC[��� Sh���)%&�zi,�+J,4R�\Y4R>�#Bt/�T���O(R:,CU4h#�Q�:<3x\;��i�';�+�bVKC"H;#Bt��$H;40CU�"!$')(r�"';!$4AC Q #�!�:<>�>)�$H;4.%&���z4R!$4R� �LCU4A�)C"4ACA�� (Z��� � ���5� �1��# ���"��� �2��� �������6# ����"��� (

��"����1� �+������ �� � �� &�����* � � ��"����+&�����5"�� � ��&1� � �� ( ,

� (Z��� � ���6�" ������2��� �2��� �������6#����� ���"����#����"��� (��"���� ���8(Z��� �� � �� &����� ����� * � � ��"����1 ��1� &�����5��� �� � �� ( ,

� (Z�������& ��� ���2��� �������� ���6� �6� ��& ���� �����& ����7 �6�" 4 � ����5������( # �� �# ��� �� ��� ��&���@$ �� � �� � � � (���7����

#�& �����������@$ � ����& ��� ��������� (#�&��@$"� %$ �����������& ����� ������

Page 41: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �����!�� � � � � � � ��� ��� � � ��� � ���������� ���� � � ��;� E��* � ��# �� �#���� �� 4 � ���5����� ����������& ����@$ �� � �� ����� �6#�&��F$2� $ �����������&<( ,

� ( ��� ���%$ ���" .���&�� �"���.������� �+#���& ����� ����5����& ��"���6��"��� (� �� �@$ ���8( � ��&���������( � ����� �#���&��������� �� @$ �����* � ����%$ �������+������� �������������� ��� � ��&�� -6������� ( ,

� (>$ ������� ��� ���%$ ���" ��� �"�@$ ������� $ ����� ��� ���6 ��� (�� ����� � �� �@$ ���<( ��������������������� �� ��"������&�* �� � ��� �� ��"������&� � �� �%$ �� �� � ���������������������8(-,

� ( ����������#������1���67����� ����&���"�����" ��#����"������#��"������"������ �� ��& �� � ���� ������ � � � ( ������ �� � ��

#����� ��� �6��� ���������������� (� ��&����� ���� �* � �6����� �����& �������1�� � ���� ������+� 6&�����5"�� � � �� ( ,

� ( & ���%$2�6� �+��� ���%$ ���� ��# ���"��� �2��� ������� ��� (� �%$ �� � � �� �%$ � � � ( ������ �� � �� ����7��* � �%$ � ��7��6��� �� � �� � � �� �%$ ( ,

� ( ��& ��7 ��� ����5������������ �� � � �����+����� �6& ������ � � ( � �& �� 1 �# ��� ��� �� ��� �������������* 4 �%$ ������������� �� ���5� � �����"�� ��1�� �+ �# ���"����� ��6�� � � � �&8( ,

� ( � ������ ���������+����������"���+�� ����"� � ���������� ��� (��"��6�� ��� ������ /"����1�� ��5/������1 �#����* �"��1�� ���+/��������� �� �# ���+��������<( ,

� �<()�2���� ��� � ��� � ���"��� ����� �!�"����# ���������6#�����������6������ (/�"��� ��"���� �� �6� � �� ������(Z# ����� �� �������&*�� �� �� ��"����1� �&��5�� �6# ����� ��6�� �6�� � �� ( ,

��� ( & ���@$ �6� � $2 ���������� .�2�����������6#��������� �6� �1���������"������ (& �%$ �� � $2 ����� � �� (Z�� � �� � �&����� �������* � �@$ ������ �� �����1� 6&�����1�� �6� � �� ( ,

� � ( & ���@$ ���" ��� � ��1����� �5&���"��� �� � (� �%$ ���8( �� ��� �� ��������������* � �@$ �� ������������� �� ���8( ,

� �<(>$ � �������" !� ���� �"��� ����� � �������%$2� $2� � $ ������� (�� � ��� ���8(Z��"�� � � �� #�&�� �� %$2� ��� &�� ��� ��7��* �� ����� &�� ��� ��7��1����� �� � �� ��5� #�&�� �� ( ,

� � ( ����$2��� �5��"���5������ ���6 � � ��� �� � (

Page 42: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

W�y ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� �

� ���� � ����� ����7����/�&���������� � %$2����"�����*�� ��+���7��+����� �/�& ��������� � %$2����������8( , * $ ��&����� ���������� ���",

� � ( ��� �� ���� �"��� ��� ������� �� � �1��� ���(� ����� ����������&� ���7��� �� %$2� � @$2�* � @$2� ����������&�����7�� �� %$2�6� � ���<( , * $ ��&���� ���������� ���", ��7����

� � ()�"��������#���&�� ����� ���� �1� ������ � ��� �����6�� � (� ����#���& �� � �� �����!7���&�� �� ���* ��� �� ��� �"����#���& �� 7���&�� �� ���8( ,

� � (Z��� ������ ��������"��&��5�����& � ���������� ���������� ���6 � � (��"����'&������"����� � %$2� �� /�������* ��� ��"����6/������� � 6� � %$2�5&������"�����<( ,

� � (>$ � �������" ���& �� ��& �6 6& ������� � � (�� � ��� ���<(Z ������ �� � �����&�&������* �� �����+���6� ���� � �� � ( ,

� � (>$ � ��������� # � � $2� � ��& ��� � � (�� � ���������8( �� %$2� �� %$2� �1#������ �����7 ���* �� �����+���5�� %$ � ���� ����<( ,

� �<(>$ � �����6� � � �� ���%$2�+����"��������2� $ �� ��������� �������������� � ��� �� � ��� �%$ ����8( �����1������ �/ ����� � �������

� � ��"����������� �� � � (� � � ��"����� ��* �� �������5� ��� � ����%$ ������1����������� �/ ������+��5�� � �1��"�����8( ,

k � k �b%&4A�,�$��Q V�35#&%&� )4R! � 35#&%&� )4A%�!$4R>�:B�$�+#,� :<�)% �"H)4 �):<�"';!$4 #<QD35#&%&�� Y(R:B�$�+#,�:<35#,�;iD(r#��MCb�$���$';4R� �$C���� 4A:,(IH�#�Qq�"H)4.Q #�>�>+#BtL���;iDCU4A� �"4R�M(r4AC��� ( & ���%$2�6#������"��� #"��������& � �����& �6� �������

& �%$ /�������& ���7��������&������ � %$"� / �����* � �%$ / �����5 %$2�5���7 �������&������ /�������&2,

� ( & ���%$2�6� ��#� �������"���� ��� ��� �+������� �����&���� $ ������ ���& �%$ �� � ��&��"���+� � ����� �� � ��������6���"�����'������* � �%$ ������ �� �& � ���"�����5�� �����1�� � ��&������2,

k � o �b%&4A�,�$��Q V�35#&%&� )4R! � 35#&%&� )4A%�!$4R>�:B�$�+#,� :<�)% �"H)4 �):<�"';!$4 #<QD35#&%&�� Y(R:B�$�+#,�:<35#,�;iD(r#��MCb�$���$';4R� �$C���� 4A:,(IH�#�Qq�"H)4.Q #�>�>+#BtL���;iDCU4A� �"4R�M(r4AC��� ( � �%$ �����1�� ��� �� � ��� �� ��&�������� ���+�� �5&� � %$ (� ( � �%$ #���&����������� � ��� � ��� 6� 6���� $ ��&�� ���8(

Page 43: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �����!�� � � � � � � ��� ��� � � ��� � ���������� ���� � � ��;� W)�k � � 12H;#Bt �$H;4�35#&%&�� M4R! � 35#&%&� )4A% CU�"!$')(*�$';!$4DQ #�!/�$H;4 %&#,35�+�):�� �xCU4A�)C"4�#<Q��"H)4Q #�>�>�#BtL�+�;i CU4A�,�$4R�)(R4AC �+� Sh���)%&� � ?h>+�"4A!"�M:B�"��J�4A>+V��9V�#,' 35: V �"!I:<�MCU>�:B�$4D�"H;4OSh���)%&�C"4R� �"4A�)(r40�"#DV,#�';!�35#<�$H;4R!��$#��;i,';4/:<�)% C"H;#Btd�+�$CLCU�"!$')(r�"';!$4��� ( ����������� � � #��������� ��������� (

�� �� ��&�� � ( � �� �/ ��& ���/* � ���� �� ���/ � � �� �/ ��&2,

� ( ����������� � � � #����� ��� ���������� 7 ������������ � $2� ��� �� ��&�� � (Z/�"� �� � �� �/���& ���/ �� ���1� ��&���� ���

��� ���!������!������ (��& �/������ /���* � � � �� �/ ��&+������1�� �6�� �� ���/1/������& �/������ ���1�� �5� ��& ���� ,

�<( �����������5� � #��������� ����� � ����� � $2� � ���������� 7������# ���� ��� �� ��&�� � ( ���� �/ ��&6/�"� �� ����& ���� ��� ���/ ������1��&���� ��7 ���

�� �����& ��� ������ (/"���� ����������* � �6� ��& ���� ���1/�"���+�� ���� �� ���/+�� � ���� �/ ��&6/��� ���������/"���� ��&���� ( ,

k � � 12H;#Bt �"H)4L3K#&%&� )4A! � 35#2%;�� )4s%xCU�"!$')(r�"';!$4�Q #�!v�$H;4L��C"#�>�:B�$4A%KCU4A� �"4R�M(r4AC[�+�D6[� �i�>���CUH��$!$:��)C">�:<�"4A%O�$# V,#�';!G3K#��"H;4A!h�$#��;i,';4 i,�+J,4R��\Y4R>�#Bt ~ ��� (A:�C"47#<Q :�3 \;��i�')���bV��C"H;#BtuQ #,!��"H;47%&#,35�+�):�� �LC"4R�MCU4,� � �� ( � �6� ��5#���� �����+���� � �� �/���& ���"����"���8(� ( � �6� ��5#���� ����� � &�� � �� �/ ��& ��� � (�<( � �6� ��5#���� �����+���� � �� �/���&5/�"���+/������& �/"�����

���+����5� ��& �����(� ( � �6� ��5#���� �����+���� � �� �/���&1��& �/"����� ���1�� �5� ��& ����� ( � �6� ��5#���� �����+���� � �� �/���&1&������"����� ���1�� �5� ��& �����(� ( � �6� ��5#���� �����+���� � �� �/���&5/�"���+/���5��� �����"��1�� �

&������� (� ( � �6� ��5/�� #���� ��� �+�� � ���� �/ ��&6/��� /������2����� ���+�� �

� ��& �����(� ( � � ���� �/ ��&+������5/��� #���� �%���1/��� ��& �/������1/"����8(

k � � |}!"�+�"4K:Di�!I:<353D:<!�Q #,!h�"��354 4R82=)!"4sC"C"�+#,�)CL���]V�#,';!h>�:<�;i,'):<i,47CU'M(IH]:�C�� )J,4# � (r>�#&( � �[\M4RQ #�!$4 )J�4 # � (r>�#&( � �[H):<>+QG=M:�CU�K�$H;!$4R4 �PCU#2#,� :BQ �$4R!5�$H;4 4R!$';=&�"��#�� � #��)435�+�2'&�$4G4s:<!$>+��4R![�"H):��D�"H;4 )!$�+�)i �,�"H;!$4R40%;: V&C[>�:B�"4A!��,�"#,35#�!$!"#Bt ��%): V5:<Q �"4A![�"#,35#�! �!$#Bt ���btP# %): V2CK:<�M%��"H;!$4R4OH;#,';!$Cx:BQ �$4R!K�"H;4 )!$4 �[:<Q �"4R!x�"H)4OC"4A(R#��)% 4R8&=;>+# CU��#�� �4r�I(<�

Page 44: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

W,E ����������� � !��� � �!� ����� �������� �! � ����� ��� � �!� ��� ������ ���� �

Page 45: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ������� � �

� � ��� � � � � � � � � ��� � �

� �� � %w53. �����g4653'��8%|}4G%&4 )�;4G: t�#,!$%x�$# \Y4G: C"4A� ';4A�)(r4@#<Qq(IH):�!$:,(*�"4A!$C9%;4R>��+35�+�"4A% \2V5C"=):,(r4AC���=)';�)( ��"'M:B�"��#�� 3D:�! �&C���4R�$(<� ��� (R:,CU4D#�Q��"H;4�tL!"�+�U�$4R���"4R82�A� ��H;4A!"4D��C �)#]%&� ��(R';>��bV������%&4R� �"�+Q V2�+�)i0tP#�!I%;CT���x�$H;4�tL!"�+�U�$4R�x�"4R8 �[4A� �"4R!$4A%x���,�$#@�$H;4h(r#,35=;'&�"4A!9\M4s(R:�')CU4P#��)4C"�+35=;>�V H):,CP�"#5>�# # �DQ #�!��$H;47%&4A>+��35���$4R!ICR�

? tP#�!I% (A:<� \Y4�#<QP�btP# �bV =Y4AC��xC"��3K=)>+4 :��)% (r#,35=M#,';�)%�� ? C"�+35=;>�4�tP#�!I% 9(r#,�)C"��CU�$CG#<Q�: !"#2#��G#�!.CU�"4R3 �$#�i�4R�"H;4A!GtL�+�"H�C"'��5824sC@#,!G=)!"4 ;8&4ACA�0? (r#,3K=Y#�')�)%tP#�!I%d~�:�>�C"# (A:<>�>+4s% :}(r#,�Bab#����;4s% tP#�!I%)� (A:<� \M4 \;!$#��,4R� ')= ��� �"# �bt�#}#�!535#�!$4���)%&4R=Y4R�M%&4R� �GtP#�!I%;CA� 6 :,(IH #<QT�"H;4K(r#��MCb�$���$';4R� �htP#�!I%;CL���]:D(r#�35=Y#�';�M% t�#,!$%���C4R�+�"H)4R!h:5(r#,3K=Y#�')�)%Ot�#,!$% #�!L:5CU��35=;>+4/tP#�!I% :��)%�35: V \M4/')C"4A%����)%&4R=Y4R�M%&4R� �">�V:�CK:]tP#�!I%�� XG� �$H;4�#��"H;4A!xHM:<�)% �[�"H;4O!"#2#��K:<�M%��"H;4 : �58&4AC��9tLH;��(IH :�!"4O(r#�� �CU�"�+�"';4A�,�IC #�Qq: C"�+35=;>�4@tP#�!I% � :<!$4h�;#<��:<>�>M���)%&4A=M4A�)%&4A�,��tP#�!I%;C[:<�M%�(R:��;�;#<�P#&(R(r')!:�CLC"4R=M:<!I:B�"40tP#�!I%;CP�+�O�"H)4.�"4r82�s�

��#��MCb�$���$';4R� �$Ch#<Q[:DCU��35=;>�47t�#,!$%O:<!$47(R:�>+>�4A%O35#�!$=;H;4A354ACL#,!L3K4s:<�;���;i�')�;���ICR���H;4L#BJ,4R!I:<>�>&3K4s:<�;���;i.#<Qn:.C"�+35=;>�4htP#�!I%x(R#�354ACvQ !$#�3 �"H;4L35#,!"=;H)4R354AC[:��)%x�"H;4A�+!!$4R>�:B�"��#��MCUH;��=)CA�x12��35�+>�:<!$>+V��n���}(A:�C"4 #<Q�:�(R#�35=Y#�';�)% tP#�!I% �����IC.354A:<�)�+�;i�Q #�>�>�#BthCQ !$#�3 �+�$Ch(R#��)CU�"�+�"')4R� �ht�#,!$%)CP:��)% �"H;4A�+!h��� �"4A! � !"4A>�:<�"��#��)C"H;��=)CA�

� �/CUH;#,';>�%]\Y4K�)#<�"4s%��$H):B�.t�4KH): J,47�$:���4A� :�=)!$:�i�3D:B�$��( =M# CU�+�"��#�� !"4Ai,:<!I%&���;itP#�!I%;CR�v?h�2V �"H)�+�;iK�$H):B�h��CP��%&4A� �"� M:<\;>�4.')C"�+�;iK�$H;4/%&4R>��+35�+�"4A!$C���CL:Kt�#,!$%�� ��H;��C���C:K(r#��2J,4R�;��4R� ��=Y#,C"�+�"��#����$# �I:��,4hQ !$#�3��"H)40=)!"#&(r4sC"C"���;i J2��4RtL=Y#����,�s�[12�+35��>�:�!���C��"H)4(R:,CU4.tL�+�"HO�"H)47%&4 )�)���$�+#,�O#�QT(R#�35=M#,';�)%OtP#�!I%;CR� �¼ � Ô�ÄÉ×>Ñ¢ÈÉÁ �lÊ�À�Í ÄÉÔ � ��Ç´ÃcÄÉÔMÓ¢Ô�Ó¢Ç�ÈÉÈ Õ ½ Ç�ÈÉÈÉÁkÍ`Ã!�¢Á �NÊ�À�ÍWÏ� Ì Ã±Ô �¤Ê�Ó¢ÈÉÍ ��Á8¢Ê�Ã�ÁkÍgà �¢Ç´Ã ÈÉÄÉÂ���Ó¢ÄÉÔ�Ã�Ô ��ÇpÒ*Á Ñ�Ç�ÄÉÍ�Ç ��À�ÁpÇ´Ã Ç�×>Ê�Ó¤Â�Ã`Ê�Ë Ç´Ã�Ã�ÁpÂ*Ã�ÄÉÊ� Ã�Ê Ã �¢Á½ Ê� ½ ÁkѤÃTÊ�Ë �NÊ�À�ÍWÏ S �¤ÁkÕ ��ÇpÒ*Á6Ã�À�ÄÉÁkÍ Ã�Ê Ç�ͤ͢À�ÁkÔ�Ô3Ã!�¢Á6à �cÄÉÂ&ÄÉÔ�Ô�Ó¢ÁkÔ3Ê�Ë�� �¢Ê ��Ä Ã3ÄÉÔ1Ñ¢À�Ê�¢Ê�Ӣ ½ ÁkÍ��Ç�Â¢Í �¢Ê �DÄ Ã#��ÁPÃ�ÔSÄ Ã�Ô\×>ÁpÇ�¢ÄÉÂ��¢Ï S �¢Á Ó¢Â¤Ä Ã�ÔTÊ�ËNÑ¢À�Ê�Â)Ӣ ½ ÄÎÇ´Ã�ÄÉÊ� Ç�À�Á6à �¤Á>Ñ��¢Ê�¢Ák×>ÁkÔ � � �¢ÄÉÈÉÁSà �¢ÁÓ¢Â¢Ä Ã�Ô/Ê�Ë\×>ÁpÇ�¢ÄÉÂ��©Ç�À�Á±×>Ê�À�Ñ��¢Ák×>ÁpÔpÏ Ð�Ê�À>Ã!�¢Á ÈÎÇ´Ã�Ã�ÁkÀ �MÃ!�¢ÁPÕ)��ÇpÒ*Á±Ã�À�ÄÉÁkÍ Ã�Ê8Á-V)Ñ¢ÈÉÊ�À�Á±Ò�Ç�À�ÄÉÊ�Ó¤ÔÄÉÔ�Ô�Ó¢ÁkÔlÇ�Ô�ÄÉÈÉÈÉÓ¢Ô�Ã�À Ç´Ã�ÁkÍ ��ÕTÃ!�¢ÁcË Ê�ÈÉÈÉÊ �cÄÉÂ��GÁ-V¤Ç�×>Ñ¢ÈÉÁkÔ��@Ì~Ô�� ½ Ç�¢¢Ê�Ã�� Ç3Ô�ÁpÑ¢Ç�À Ç´Ã�Á �NÊ�À�Í ' ��Ç´ÃNÄÉÔqÄ Ã�ÔÀ�ÁkÈÎÇ´Ã�ÄÉÊ�Â¢Ô �¤ÄÉÑ`Ã�Ê�� � Ç�Â"Y Ã�� � ÈÉÁpÇ�À�È Õ ��Ê�Ã!�±Ê�ËEà �¤Áp× Ô ��Ç�À�Á1×>ÁKÇ�¤ÄÉÂ����cÄ Ã ��� ½ Ç� ¢Ê�Ã����+�¤Ê �NÁPÒ*ÁkÀ �

W�W

Page 46: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

W<� ������� ��� � � ���� ������� ����� �� ������ �� � �

|l�+�"H �"H)47:<\Y#BJ�4/%&4 M�;���$�+#,� �M:��]:<�):�>+V2wA4R!�#<Q9tP#�!I%;C��+��:DC"4R� �"4A�)(r47%;# 4sCL�;#��H): J,4.�"#�%;#�3 ')(IH�tP#�! � ���]��%&4R� �$��Q V2���;i�:DtP#�!I% �����.CU��35=;>+V H):,CL�$#�>+#2# � Q #,!h�"H)4%&4A>+��35���$4R!ICR� � S@: J2���;i���%&4R� �"� )4s% �"H;4xt�#,!$% �)�+�G3 'MCb�.%&4r�$4R!$3K���;47tLH)4r�"H)4R!0���0��CG:(r#,35=M#,';�)% tP#�!I%}#�!xC"��3K=)>+4�t�#,!$%��-� Qh���K��CK:](r#,35=M#,';�)% tP#�!I% �T���K3 ')CU� )!ICU�\;!$4A:�� �+�G';=���� �"#��+�$C0(r#,�)Cb�$���$';4R� �GC"��3K=)>+47tP#�!I%;CL\Y4rQ #,!"4 =;!"#&(R4R4A%;�+�;i5�$# :<�M:<>�V wA4�"H)4R3 ��|}4 (A:<>�><�"H)49Q #�!$354R!q:,C�1&:��)%&H;� :<�):�>+V2wR4A!n:<�)%0�$H;4[>�:B�"�"4R!T:�C�35#,!"=;H)#�>�#�i���(R:�>:<�M:<>�V wA4R! �2\M#��"H #<QvtLH;��(IHO:�!"4.��3K=Y#�!"�$:�� ��=M:<!"�$C�#<Qv:5t�#,!$%�:<�):�>+V2wA4R!s���H;4 %;4r�$:��+>�4A% >����;i�';��CU�"��(7:<�):�>+V&C"��Ch#<Q :DtP#�!I% (R:<��\Y47')C"4rQ ')>qQ #,! �@p�Zv�MS@#Bt �

4RJ,4R! �<35#,CU� �@p�Z !"4sCU4s:<!I(IH;4R!IC�H): J�4L(r#,�)(r4A� �"!I:B�"4s%K#��5#<�$H;4R! :,CU=Y4A(r�$C���4,� iM� �,i�!I:<3 �3D:B�$��(A:<>�:��):<>�V&CU��C��TC"4R3D:<� �$��(D��� �"4A!"=;!$4r�I:B�$�+#,� �v4r�$(��-?@CK:�!$4AC"';>+��� �@p�Z C"V2CU�"4A3DC')C"4�!I:B�$H;4R!5C"�+35=;>�4�35#,!"=;H)#�>�#�i���(R:�>�:��):<>�V2wR4R!ICA� ��#,�)CU4s� ';4R� �">�V � #�';!5%&��C"(R')C"C"��#���"#2#5tP#�';>�% \Y4/>��+35�+�"4A%O�$#5!$:<�"H;4A!hCU��35=;>+4��2���)%;C�#�QT35#�!$=;H;#,>+#,i���(R:�>Y:��):<>�V2wR4R!ICA�

12#�Q�:�!xtP4 HM: J�4D�I:<> ��4A% :�\M#,'&�K:��):<>�V2wR4A!$CA�-?�i�4R�)4R!I:B�"#,! %&#24AC7�"H;4O!$4RJ�4A!$C"4#<Q :��-:<�M:<>�V wA4R!s�@c0�+J,4R�-:�!"#2#<�0:<�)%��+�$C@Q 4A:<�"';!$4ACx~ #,!0: �K8&4sC$� �Y:D35#,!"=;H)#�>�#�i���(R:�>i�4A�;4R!I:B�$#�!9i,4R�;4A!$:<�"4AC :.t�#,!$%��912��35�+>�:<!$>+V��,:7C$:<�M%&H;�)i,4R�;4A!$:<�"#,![(R:<�5�I:��,4��"H;4h#,'&� �=;'&�0#<Q[:D35#�!$=;H;#,>+#,i���(R:�>�i�4R�)4R!I:B�"#,!��M:<�)% i,!"#,';=�CU��35=;>+4xt�#,!$%)CL�+� �$# (r#,3K=Y#�')�)%tP#�!I%;C �2tLH;4A!"4.=Y#,C$CU��\;>�4��

� ��� � � � � .\2 � � � � �8'*4>#�� !Z%g#�� �v03'*0

��H;4 M!$CU�G� ';4ACU�"��#���tP4/�;4A4A% �$#�:�%;%&!$4AC$CL��ChtLH2VOt�47�)4R4A%O�$#�=Y4R!"Q #�!$3{35#�!$=;H;# �>�#�i���(R:�>q:<�M:<>�V2C"��CL:B�G:�>+> ��� QvtP47H):,%�:<� 4r8&H):�')CU�"��J�4/>�4r8&��(R#���tLH;��(IH�>���CU�"4s%�:<>�>n�"H)4tP#�!I%KQ #�!$35C�#<Qq:�>+>M�"H)4G!$#2#<�$C��2:<�)%�:�>+#,�;i7tL�+�"H�4A:�(IHDtP#�!I%5Q #,!"3��+��>���CU�"4s%��+�$C�Q 4A: ��"')!"4sC[JB:<>�';4AC[�"H;4A� (r>�4A:�!">�V tP4@%&# �;#<� �)4R4A%D:73K#,!"=)H;#�>�#�i,��(A:<>;:<�M:<>�V wA4R!s�Tc0��J�4A��:tP#�!I% �<:<>�>&t�4��;4A4A% �"#/%&#.��CT�"#.>+#2# �/���[';=K��� �$H;4L>+4R8&��(R#��x:��)%x!"4R�"!$�+4AJ�4P���ICTQ 4A:B�$';!$4JB:<>�';4ACA� f #�!h4R8;:<35=;>�4 �MC"';=;=Y#,C"47:<� 4R82HM:<')CU�"��J�4/>�4r8&��(r#��OQ #,!@Sh���)%&�T(r#�� �I:<���)C��"H)4Q #�>�>�#BtL�+�;i54A�,�$!"��4ACP!$4R>�:B�$4A% �"#5�"H)4/!"#2#<�ICP>�: G:�� :,:5:<�)% �B:<=): G:,:��

�NÊ�À�Í¢Ô ½ Ç�Â`ÄÉÂ�Ã�ÁkÀ�Ò*Ák¢Á\Â¢Ê ��Ç�Ô ÄÉ � ½ Ç� ½ ÁkÀ�Ã�Ç�ÄÉÂ¢È Õo¢Ê�Ã��¢Ï S �¢Á1Ñ�Ê�Ô�Ä Ã�ÄÉÊ�Â`Ç�Í¢Ê�ѤÃ�ÁpÍ ÄÉÂ����@¿ ÄÉÔc¤Ê�ÃÊ�Ñ¢Ñ�Ê�Ô�ÁkÍ Ã�Ê6Ã!�¢Á1ÈÉÄÉÂ���Ó¢ÄÉÔ�Ã�Ä ½ Ñ Ê�Ô�Ä Ã�ÄÉÊ�ÂsÏ����@¿ ��Ç�Ô Ô�ÄÉ×>Ñ¢È Õ6Ã�Ç�Ø�Ák Ç6Ô!�¢Ê�À�à ½ Ó¤ÃpÏ«Ì Ã ÄÉÔN¢Ê�à Ê�Ñ¢Ñ�Ê�Ô�ÁkÍÃ�Ê6à Ç�Ø�ÄÉÂ��>Ê�À���Ák¢ÁWQ¢Ã�ÄÉÂ��/Ë À�Ê�×DÃ!�¢Á\ÈÉÄÉÂ���Ó¢ÄÉÔ�Ã�Ä ½ Ç�¢Ç�È Õ¤Ô�ÄÉÔcÄÉÂoà �¤Á1ÈÉÊ�Â�� À�Ó¤ÂWÏ& Ì ÃMÍ¢Ê)ÁkÔN¢Ê�Ã��¢ÇpÒ*ÁGÃ�Ê6Í¢Á ½ ÄÉÍ¢Á � �¢ÁPÃ!�¢ÁkÀ � ½ Ç�Â"Y Ã�� ÄÉÔlÇ#�NÊ�À�Í���Ë Ê�ÀlÁWV¤Ç�×>Ñ¢ÈÉÁ�ÏqÌ ËQÄ Ã ½ Ç�Â`Ê ½k½ Ó¢ÀNÄÉÂÇ6Ô�ÁpÂ*Ã�Áp ½ ÁTÔ�ÁkÑ�Ç�À�Ç´Ã�ÁkÍ �*ÕoÔ�Ñ�Ç ½ ÁkÔ �¢Ä ÃMÄÉÔ Ç �NÊ�À�Í`Ç�¢ͱ×SÓ¢Ô�à ��ÁTÇ�Â�Ç�È Õ��kÁpÍsÏ

Page 47: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � � � � � ���� � �� �� �������� ������ �� � � � W ��������� ���

� �������� �����

����� � ���� � � ����� "! � �$# � � �% � �

� � % �

&('�)*'�+�',' -/.�0/- &('�)1'�+,'�' 23'�4�5,6 4�786 9;:�< <8=>:@?�5�A&('�)*'�+B? <C.86 <C.86 <8.C6 DC&E6 <8.C6 <8.C6&('�)*'�+B? <C.86 <C.86 <8.C6 4�786 <8.C6 .�F/&>=(G 0C?&('�)*'�+B.BH <C.86 <C.86 <8.C6 DC&E6 <8.C6 <8.C6&('�)*'�+�'�ID/'�-J'

<C.86 &('�)1'�+,'DJ'�-J'

<8.C6 4�786 <8.C6 '�- K

+�'�D/'�)1'�' -/.�0/- +�'�DJ'�)1',' 23'�4�5,6 4�786 9;:�< <8=>:@?�5�A+�'�D/'�)*? <C.86 <C.86 <8.C6 DC&E6 <8.C6 <8.C6+�'�D/'�)*? <C.86 <C.86 <8.C6 4�786 <8.C6 .�F/&>=(G 0C?+�'�D/'�)*.BH <C.86 <C.86 <8.C6 DC&E6 <8.C6 <8.C6+�'�D/'�)1'�'�ID/'�-J'

<C.86 +�'�DJ'�)1','DJ'�-J'

<8.C6 4�786 <8.C6 '�- K

�h#Bt �&i,�+J,4R� :Kt�#,!$% �&�+�@(R:���\Y4/>�# # ��4s% ';= :<�M%��+�$CLQ 4A:B�$';!$40JB:�>+';4sC�!"4R�"';!$�;4s%����H;4.:<\Y#BJ�4G3K4R�"H;#&% H):�C�C"4RJ�4A!$:�>M=)!"#,\;>+4A3DCR� f �+!ICb� �&���L��CP4r82�"!$4R354R>�V5tP:,Cb�$4rQ ';>

#<Q�354R35#,!"V5CU=M:�(r4,�T6 J�4A!"V Q #�!$3�#�QY�$H;4@tP#�!I%K��C�>���CU�"4s%5tLH;��(IH�(r#�� �$!"��\;'&�$4ACv�$#7�"H)4>�:<!$i�4/�2';3 \Y4R!@#<Q94R� �"!$��4ACh���]C"')(IH]:5>+4R8&��(R#��n�L6[J,4R� tLH;4A� �bt�#D!$#2#<�$CLQ #�>�>+#Bt �"H)4C$:<354.!"';>�4 �2�$H;4/=;!$4AC"4R� �hCUV&CU�"4A3�CU�"#�!$4AC��$H;47C":�3540���&Q #,!"3D:B�$�+#,��!$4A%;';�)%;:��,�$>+V,�

124s(r#��M% �;�+�0%&#24ACh�;#<�GC"H;#Bt !"4A>�:<�"��#��)C"H;��=)Ch:�3K#,�;iD%&� �Y4A!"4A�,�G!"#2#<�IC��"HM:B�@H): J,4C"�+35��>�:�!/t�#,!$%]Q #�!$35CA� ��H2')C �����.Q�:��+>�C.�"# !$4R=;!$4AC"4R� �/:O>+���;i�')��CU�"��(5i�4A�;4R!I:<>��+ws:B�$�+#,�n���H;��C.��C0�;4s(r4sC"C$:<!$V���Q��"H;4DC"V&Cb�$4R3 ��CG�"# H): J�4x�"H)45(A:<=):�\;��>+�+�bV�#<QP';�)%&4A!$CU�$:��)%&���;i~ 4AJ�4A� i,';4AC$CU���;i2�@:�� ';� � �)#BtL� tP#�!I%���~����-Q�:,(*� �qH2';3D:<�}\M4A�+�)i,C.!$#�'&�$�+�;4A>+V]%;4A:<>tL�+�"HKt�#,!$%7Q #�!$35Cq�"H)4RV7H): J,4��)4RJ�4A!�H)4A:<!I%7\Y4rQ #,!"4PtLH;4A� �$H;4RV �2�;#Bt �"H;4P!"#2#��v:��)%�"H)4 : �58&4AChC"4R=M:<!I:B�"4A>+V,� ����� �"H;4xi�4A�;4R!I:B�$�+#,��=;!$#&(r4sC"C��&�"H)47>+���;i,';��CU�"��(��2�;#BtL>�4A%&i,4(R:���\Y4/')C"4A%O�+Q��$H;47CUV&CU�"4A3 �;4R4s%;C��$#5(R#����O:5�)4RtdtP#�!I%����H;��!$% ��C"#�354 >�:��;i�'):�i�4sC H): J,4O:}!$��(IH :<�)% =;!$#&%&')(r�"��J�4O3K#,!"=)H;#�>�#�i,V�� ��H)4

�2';3 \Y4R! #<Q�t�#,!$% Q #�!$3DC.35�+i,H,�7tP4R>�> \Y4D���� )�;�+�"4���� C"')(IH :�(R:�C"4�� ��>+4s:<!$>+V��n�"H)4:<\Y#BJ�40354r�$H;#&%O(A:<�;�)#<�h%&4A:�>ntL�+�"H�CU'M(IH�>�:<�;i,'):<i,4ACA�

_�#,!"=;H)#�>�#�i���(R:�>9:<�):�>+V&C"��C tL���$H %&���z4R!$4R� �5%&4Ri,!"4A4AC/#�QLC"#�=)H;��CU�"��(R:<�"��#�� (A:<� \Y4(R:�!"!$��4A%5#�';�A�9?@C�%&��C"(R')C$CU4s%D�+� �"H;40>�:�CU�PC"4A(*�$�+#,� �235#,CU� �@p�Z C"V&Cb�$4R3DCP')CU40CU��35=;>�4>��+�;i,';��Cb�$��(0�$H;4R#,!"��4AC�Q #�!@3K#,!"=)H;#�>�#�i,��(A:<>z:<�):�>+V&C"��CA� ��H)47C"(IH;4A3540tP4/tL��>+>n%&4sC"(R!"��\Y4Q #&(r')C"4ACK#,� �"H)4 M!$CU�D��C$CU')4}~ CU=):,(r4O!"4s� ';�+!$4R354A�,�*�*� � ��(A:<� %;4A:<>�tL�+�"H �"H;4�C"4A( �#��M%]��C"C"';4 =M:<!"�"��:<>�>+V,�.S@#Bt�4AJ�4A!��YtLH;4R�-�"H;4K35#�!$=;H;#,>+#,i�VO\M4s(r#�354sC@!$��(IH ~ ��C"C"';4KW:<\Y#BJ�4 � �2�$H;47C"(IH)4R354.tL�+>�>��;#<�h\Y47:<\)>+40�"#DHM:<�)%&>�4.���s���H;4A!"4x��C0:<�;#��"H;4A!0(R!"�+�"4A!"��#���\2V�tLH;��(IH��$# ab')%;i�4x: 35#�!$=;H;#�>�#�i,��(A:<>T:<�):�>+V2wR4A!

#�!5:-C$(IH;4A3K4 Q #�!K35#�!$=;H;#�>�#�i,��(A:<> :��):<>�V&CU��CA� ��H;��CK��C �"H;4 C"=M4A4A% tL�+�"H tLH;��(IH �+�=Y4R!"Q #�!$35CL�"H;4 :��):<>�V&CU��CA� ����(R:,CU4/#�QT�$H;474R82HM:<')CU�"��J�4.>�4r8&��(R#�� �)�"H;47�"��3K4xCU=Y4R� �@���:<�M:<>�V2C"��C ��C�wR4A!"# ���$H;4.#��;>�VD�"��354.�;4R4s%&4A% ��C����OC"4A:�!$(IH)�+�;ix:<�)%�!"4R�"!$�+4AJ2�+�;iK: tP#�!I%Q !$#�3 �$H;4�>�4r8&��(r#��q��?@C/�"H;4 :��):<>�V&CU��C/C$(IH;4R354D\Y4A(r#,354AC735#,!"4DC"#�=;H;��CU�"��(R:B�$4A% �T�+���CD:<>�CU# >+� ��4A>+V �$#-�I:��,4�35#�!$4��"��3K4,� ? =)!"#,=M4A!x\):�>�:��)(r4O3D: V � �"H;4A!"4RQ #�!$4 �[H): J,4�"#�\Y4]Cb�$!"'M( �Y� ��H;4�C$(IH;4R354ACK=Y#�=;')>�:�!D�+���@p�Z H): J�4 (IH;#,C"4R� CU=Y4R4s% #BJ,4R!K�"H)4

Page 48: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

W�^ ������� ��� � � ���� ������� ����� �� ������ �� � �

!$4A� ';��!"4A3K4A� �$CP#<Q9%&4A:�>+���;i5tL�+�"H ';� �2�;#BtL�Ot�#,!$%)C�4R�$(�� �

� ¢��� �Q� � �*� ��{~� ����} �s� � {������12���;i�';>�:<! >�: G:��B:�: >�:�0:��,4Z[>�';!I:<> >�: G:���4 >�:�0:��,#,_

�9#&(R:B�$�+J,4/(R:�C"4.H):�C��)#<�h\Y4R4R��C"H;#BtL���"#���4A4R=��"H;4/4R8&:�35=;>+4/C"�+35=;>�4��f �+i,';!"4/W)�+� �T|}#�!I% Q #�!$35CPQ #,!��"H;4/!$#2#<�L>�:�0:��B:�:

� ¢��� �Q� � �*� � {~� �´��} �/� � {��*���12���;i�';>�:<! ~�y ���z� ~U� �;4 �Z[>�';!I:<> ~b���;4s� ~U� �;# _-�

6�:�(IH 4A� �"!$V��+�O�$H;4.�$:�\;>+47C"H;#BthC��"H)4/� ')3 \Y4R!L#<Q9(IH):�!$:,(*�"4A!$C �"#\Y47%&4R>�4r�$4A%�Q !$#�3 �$H;4/!"#2#��L:��)% �"H;47CU�"!$�+�)ix�$#5\M47C"'��58&4A%��

f �+i,';!"4/W)� E��vZ9:�!$:,%&��i�3 �$:�\;>+4.Q #,!� >�:�0:��B:,: �&(r>�:�C$C

� ��� � .\2 � � � � �w'*4>#�� � ,o%g,/.1# 51' �w%�� 03'�%�� "-# .1# ��' � 0

��H;4/C$(IH;4R354.t�40tL��>+>q%;4AC$(r!$�+\Y4G�)#Btd��C�\):�C"4A% #��O=):<!I:�%&��i�3DCA� ��H)��C�#,!�:KJB:<!$��:<� �#<QT�"H)��CLC$(IH;4R354/H):,C�\M4A4R� ')C"4A%�tL��%;4R>�V �����GpqZv���H;4�>+���;i�')��CU�T#,!q�$H;4P>�:��;i�'):�i�4[4R8&=M4A!U�v��Cv:,C �,4A%0�"#0=;!$#BJ2��%&4P%&� �Y4A!"4A�,�T�$:�\;>�4AC�#<Q

tP#�!I%/Q #�!$3DC9(r#BJ,4R!$�+�;i@�"H;4LtP#�!I%;CT���5:0>�:<�;i,'):<i,4��q6�:�(IHKt�#,!$%�� Q #,!"3DCq�$:<\)>+4L(r#BJ,4R!IC:KCU4R�P#�Q�!$# #��$C�tLH;��(IH�354A:��)C��"H):<���$H;4.!"#2#��$C�Q #�>�>+#Bt��$H;4.=):B�"�"4A!"�}~ #�!�=):�!$:,%&��i�3����3K=)>+��(r�+� ���5�"H;4L�I:<\;>�4LQ #,![i�4A�;4R!I:B�$�+�;i0�$H;4R��![tP#�!I% Q #,!"3DCA� f #�![4R8;:<35=;>�4 �����DSh���)%&��"H)4K=M:<!I:�%&��i�3 Q #,!/>�: G:�� :,: :��)%-#��"H;4A!/!"#2#��$C0�+�}�+�$C/(r>�:�C$C.(R:�� \Y4DCU=Y4A(R�� )4s%-\2Vi���J2�+�)i����IC@tP#�!I%OQ #�!$3DCR� $ X@�$H;4R!0!"#2#��$C@C"')(IH]:,C �B:<=): G:,: ��~ (r>�#<�$HM�L\Y4RH): J,47>�� �,4>�:�0:��B:�:K:<�)%O\Y4R>�#��;iK�$#5�"H;47C$:<354.=):<!I:�%;�+i,3O���H;4]=M:<!I:�%&��i�3 (R:<�l\Y4]4R8 �$!$:,(*�$4A% Q !$#�3 �"H;4]tP#�!I% Q #�!$3DC�#<Q/>�:�0:��B:�:�\2V

��%&4R� �"�+Q V2�+�)i �"H;45�2';3 \Y4R! #<QP(IHM:<!I:�(*�$4R!ICh�$# \M4�%&4A>+4R�"4s%-Q !$#�3 �"H;4D!$#2#<�/:<�)% �"H)49 Ì Ã ÄÉÔMÑ�Ê�Ô�Ô�Ä �¢ÈÉÁ3Ã�Ê �¢Ó¢ÄÉÈÉÍ`Ç6Ô�Õ)Ô�Ã�Ák× Ã!��Ç´Ã Ó¢Ô�ÁkÔcÇSË Ç�Ô�à Ç�Â¢Í Ô�ÄÉ×>Ñ¢ÈÉÁGÔ ½ �¢Ák×>ÁGË Ê�ÀM¢Ê�À�×/Ç�È Ê�Ñ�ÁpÀ�ÅÇ´Ã�ÄÉÊ�Â�� Ç�Â¢Í Ç ½ Ê�×>Ñ¢ÈÉÁWV`Ç�¢ͱÑ�Ê �lÁpÀ�Ë Ó¤ÈQÔ ½ �¢Ák×>Á1ÄÉ ½ Ç�Ô�ÁTÃ!�¢Á\Ô�ÄÉ×>ѤÈÉÁpÀMÔ ½ �¢Ák×>Á3Ë Ç�ÄÉÈÉÔMÊ�Àcà �¢Á��NÊ�À�ÍÄÉÔM¢Ê�ÃMË Ê�Ӥ¢ÍWÏR � Ê�Ã�Á6à �¢Ç´Ã\Ê��¢ÈÉÄ * Ó¤Á Ê�À1Í¢ÄÉÀ�Á ½ à ½ Ç�Ô�Á6À�ÁPË ÁkÀ�ÔGÃ�Êoà �¤Á6Ë Ç ½ à � �¢ÁPÃ!�¢ÁkÀTÃ!�¢Á��lÊ�À�Í&×6Ó¢Ô�Ã3Ê�À1×SÓ¢Ô�âÊ�à ��Á Ë Ê�ÈÉÈÉÊ �NÁkÍ �*Õ&à �¤Á>Ñ Ê�Ô�ÃTÑ Ê�Ô�Ä Ã�ÄÉÊ�¢Ç�Èl×/Ç�À�Ø�ÁkÀKÏ ÈÎÇ�Ö3Ç�Ø�Ê�� �WË Ê�À\Á-V¤Ç�×>Ñ¢ÈÉÁ��QÄÉÔ1Ê��¢ÈÉÄ * Ó¢Á ½ Ç�Ô�Á��Á ½ Ç�Ó¤Ô�Á\Ä Ãc×6Ó¢Ô�Ã�� Á3Ë Ê�ÈÉÈÉÊ �lÁpÍ��*Õ ÇSÑ Ê�Ô�Ã�Ñ�Ê�Ô�Ä Ã�ÄÉÊ�Â�Ç�ÈW×/Ç�À�Ø�ÁkÀMÔ�Ó ½ � Ç�Ô X ¤Á�Y ��X Ø�Ê�Y �¢ÁPà ½ Ï

Page 49: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �� �� �� �� � �������� ������� � ������� � � ��� � � �� ����� � ��� W2e(IH):�!$:,(*�"4A!$CG�$#]\M4�:,%;%&4s%}�"#�#�\;�$:<���}�"H;4 t�#,!$% Q #�!$3DCR� f #�! 4r8;:<35=;>�4 �T\2V->�# # � ����;i-:B� f ��i�';!$4�W;���DtP4 (R:���C$: V]�$H):B�x��QLV�#,'�tP:��,�7=)>+';!I:<> �T#�\;>���� ';4�(A:�C"4D#<Q��"H)4!$# #��7>�: G:��B:�: �v%&4A>+4R�"4D�$H;4 >�:�CU�x(IH):�!$:,(*�"4A!�~ F:�: � �/:��)% :�%)%l~ #,_ �F�/:B� �"H;4�4R�)% �tLH;4A!"4 :,: � ��CL:KC"�+�;i,>+40(IH):<!I:�(r�"4A!���� G4RJB:<�M:<i�!$�zC"(R!"��=&�h:<�)% �+� �"H;4.��� �"4R!$�):�>Y!$4R= �!$4AC"4R� �$:<�"��#�� �+� �$H;4x(R#�35=;'&�$4R!K~ tLH;��(IH���C >�:�%):��&? �Y:�CLi,�+J,4R� �+�]�"H;47�)#<�$:<�"��#������?h=)=M4A�)%&�+8 N � �T:<\;>�47E�� �� !"#2#<��� >�: G:�� :,: �&�2';3x\M4A!���=;>�';!I:<> �;(R:�C"4���#,\;>+��� ';4���� >�: G:���#,_��H;��C (A:<�5\M4G4r8&=;!$4AC$CU4s% ���D�$H;4LQ #�!$3 #<Qn:0�$:�\;>+4x~ f �+i,';!$4@W;�FE��v:��)%K�"H;4G!"4s:�%&4A!

(R:���J,4R!$��Q V \ V >+#2#��2���;iD:B� f �+i,';!$4.W)�+�0�$H):B�h�+�h��C@(r#�!$!$4A(*� �� ¦ ��µ�����§¤� � o � � f #,!"35���;i5=):<!I:�%;�+i,3��$:<\)>+4° ¥ �¤¬Sµ��¤­� ��#KQ #�!$3 =):<!I:�%;�+i,3��$:<\)>+4.Q !$#�3 tP#�!I%DQ #,!"3DC��I:<\;>�40Q #�!h:K!$# #��·*  ¬G¥ §� gL#2#<�T!�� |}#�!I%0Q #�!$3DCn�I:<\;>�4[| f �l~ tL�+�"Hx>�:�\M4A>�CqQ #�!�!"#BthCn:��)%7(R#�>�#�';35�)CI�

� ¥ §�¬3¥ §� Z9:<!I:�%&��i�3 �$:�\;>�47Z �� ¦ ��µ�����§¤� ���

���@��!$4A:B�$47:<��4A3K=;�bV �I:<\;>�4 Z � #�QT�$H;4 C$:<354 %&��354R�)C"��#��):�>+�+�bV �YCU��wR47:��)%>�:<\Y4R>�Ch:�CP�$H;4/t�#,!$%�Q #�!$3DCP�$:<\)>+4/| f �.�

E&� f #,!L4RJ,4R!$VD4R� �"!$V t �+� | f ���)%&#�+Qvt�� !

�"H)4R�]CU�"#�!$4 �A~�y � �z� 5�+���"H;47(R#�!$!"4sCU=Y#��M%&�+�)ix=Y#,C"���$�+#,������Z �.�4R>�C"4/\M4Ai����>�4r���)\Y4L�"H;4@=M# CU�+�"��#��D#�QM�$H;4 )!ICU� (IH):<!I:�(r�"4R!ICT�+�Dtl:��)%5![tLH;��(IH

:�!"4.%&� �Y4A!"4A� �CU�"#,!"4�~ CU��wR4 ~ !*� ���� ���MC"'��58n~ � � t@�"�h:B�@�"H;4 (R#�!$!"4sCU=Y#��M%&�+�)iK=Y# �

C"�+�"��#��O�+��Z �W;�LgL4R�"';!$��Z �

�   ª��E¦ ��µ�����§¤� �?h>�#��)i]tL���$H �$H;4 !$#2#<�$Cx(R:�� \M4 CU�"#�!$4A%}�$H;4��bV2=Y4ACK:<�)% #<�"H)4R!Ki�!I:<353D:B�"��(R:�>

���&Q #�!$3D:B�"��#�� �"H):<�D��CD(R#�3535#�� �$# :<>�>��$H;4�:�C$CU#&(R��:<�"4A% 4R�)%;�+�;i C ~ �"HM:B�D��C�� tP#�!I%Q #�!$3DC$�r� f ��i�';!$4PW)� WGCUH)#BthC�C"#�354P4r8;:<35=;>�4 !$#2#<�$Cq�"#,i�4R�"H;4A!TtL�+�"HK(r#,3K35#,� i�4A�)%&4A!���&Q #�!$3D:B�"��#��q��h#��"4G�"H):<���"H;4/4A�)%&���;i,CP#<Q��bV2=M4D~ � � >�:�0:��B:�: � :�!"4.:<=)=;>+��(R:�\;>�4@�$#K>�:�0:��B:,:x:,C

tP4R>�>M:�C � :�=):�0:�:D~ (r>�#<�$HM� � i�H;# G:,:D~ H;#,!$C"4s� ��4R�$(<�[12��35�+>�:<! ��C[�"H;4@(A:�C"4LtL���$H�!$# �����~ \)!"4s:�%)� � >�:�0:��2�+�7~�i���!"> � ��>�:��B:�G�+�/~ tP#2#&%)� �P4r�I(<� ��H;4 =):<!I:�%&��i�3 �I:<\;>�4�(R:<� \Y4

Page 50: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

W�� ������� ��� � � ���� ������� ����� �� ������ �� � �

�`�)��} � � � � �*�������>�:�0:��B:,: ~�� � >�: G:�� :,:,� 3�B:�=):�0:�: ~�� � >�: G:�� :,:,� 3\)H):�: 1&:�: ~�� � \)H):�: 1&:�: � Q!$# ����� ~ � � >�: G:��2�+� � Q>�:�0:��2��� ~ � � >�: G:��2�+� � Qf ��i�';!$4/W;� W�� @��(*�$�+#,�):<!$V�#�QT!$#2#<�$C

')C"4A%KtL�+�"H�:<�2V7#�QM�$H;4h!$#2#<�$Cv���K�"H;4GC":�3K4L(R>�:,C"Cv�$#/i�4A�;4R!I:B�$4P�+�$C[t�#,!$% Q #�!$3DCR� f #,!4r8;:�3K=)>+4�� �B:<=): @# _(R:<��\Y4�i�4A�;4R!I:B�$4A%-Q !"#,3 !$#2#<���B:<=): G:,: �q�2';3x\M4A!7=;>�';!I:<> �:<�M% (R:,CU4�#�\;>����,')4 � \2V %&4A>+4R�"��#���:<�)% :�%;%&�+�"��#�� :�CKCU=Y4A(R�� M4A% \ V��$H;4O=):<!I:�%&��i�3�$:�\;>�4�� 124A4.?@>+i,#�!$���$H;3�W)� E;���H;��C�>+4s:�%;C��$#D4 ��(r��4R� �hCb�$#�!I:<i,4@\Y4A(R:�')C"4G�$H;4R!$4.��C�#,�;>�V�#��;4.=):�!$:,%&��i�3��$:�\;>�4

Q #�!h:5(R>�:,C"C�#�Q�!$# #��$C�!I:B�$H;4R!��$H):<� :5CU4A=):<!I:B�$40tP#�!I%DQ #,!"3DCP�I:<\;>�4.Q #�!L4s:�(IHO!"#2#<�s�� ¦ ��µ�����§¤� � o � k c04R�)4R!I:B�"���;iD:Kt�#,!$% Q #�!$3° ¥ �¤¬Sµ��¤­� ��#/i�4A�;4R!I:B�$4�:7t�#,!$% Q #�!$3�i,�+J,4R�D:.!$# #�� :<�)%D%;4AC"�+!$4A%xQ 4A:<�"';!$4LJB:<>�';4AC·*  ¬G¥ §� gL#2#<�h! � f 4s:B�$';!"4.JB:<>�';4sC f �� �)­@� � Z9:�!$:,%&��i�3u�I:<\;>�4AC�� @��(*�$�+#,�):<!$V0#<Q;!$# #��$C Gg � G��(r�"��#��):�!"V0#<Q;���)%&4s(r>��+�):�\;>�4

t�#,!$%;C G�� ¥ §�¬3¥ §� | #,!$%�t� ¦ ��µ�����§¤� ���

����� Qv!"#2#<�L!L\Y4R>�#��;i CP�"# G��"H)4R� !"4R�"';!$��~ tP#�!I%�CU�"#,!"4s% ��� @��Q #�!L!L��!"!$4AC"=Y4A(*�$�+J,4.#<Q f �.�

E&��>�4r�h= ��=):�!$:,%&��i�3��bV2=M4/#�QT!h:,C�#�\&�I:<���;4A% Q !$#�3 0gW;��>�4r�@Z ��� =M:<!I:�%&��i�3��I:<\;>�40Q #�!L=n��)��>�4r� ~ � � CI� � 4A� �"!$V��+� Z �dQ #�!�Q 4s:B�$';!"4.JB:<>�';4sC f ��&��t � � !L3K���2')CL��(IH):�!$:,(*�"4A!$CP:B���$H;4/4R�)%^;��t � � t =;>�')ChC"'��58�C

�   ª��E¦ ��µ�����§¤� ��h#��"4 �"H):<�x�$H;4�!$#2#<�IC ��� �"H)4O%&��(*�$�+#,�):<!$V�#<Qh!$#2#<�$CKC"H;#�';>�% \Y4 �,4R=&�DC"#�!"�"4A%n�

��H;��C�:�>+>�#BthC�')C[�$# #,\&�$:��+� �"H;404R� �"!$VKQ #�!�:7!$#2#<�G~ Cb�$4R=OE7�+�O?h>�i�#,!"�+�"H;3 W)� E,�9J�4A!"V!I:<=;��%&>�V��5XG')!0#BtL� �+� �$';���$�+#,�-�$4R>�>�C.'MC0�"H):<�/C"4A:�!$(IH)�+�;i Q #�!7:��-�+�"4R3 �+� :OCU#,!U�$4A%>���CU�h��C@3 ')(IHOQ�:,Cb�$4R!s�[| 4/HM: J�47:<>�>n4R82=Y4R!$��4R�)(R4A% �"H):<�GCU4s:<!I(IH;���;i Q #,!@:5tP#�!I% ����:

Page 51: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �� �� �� �� � �������� ������ �� � � � � � ��� � � �������� � ��� W,�%&��(*�$�+#,�):<!$Vx��C�J�4R!$VK!$:�=;��%5\Y4A(A:<')C"4h�$H;4@tP#�!I%;C�:<!$4@CU#,!U�$4A%��T|lH):<��tP#�';>�%DH):�=;=M4A��+Q��$H;4/t�#,!$%)C�tP4R!$4.�;#<�@C"#�!"�"4s%�����:K%;��(r�"��#��):�!"V�� 3<�

|}4DH): J�45CU# Q�:�!.�$:�> �,4A% #<Q�i�4R�)4R!I:B�"���;i : t�#,!$%-')C"�+�;i�=M:<!I:�%&��i�3DCA�K���}Q�:,(*����"H)4GtP#�!I%KQ #�!$3 �$:<\)>+40i���J�4A�D\ V5�$H;40>�:��;i�'):�i�4L4R82=Y4R!"����C Q !"#,3 �"H;40=M#,�+� ��#<QnJ2��4Rt#<QLi,4R�;4A!$:<�"��#��n�O� �x��C C"4r� ')= CU#��$H):B�xi���J�4R� :�!$#2#<�x:��)% �"H;4O%&4AC"��!"4s%}Q 4A:B�$';!$4AC��#��)4K(A:<�}>+#&(R:<�"4x�"H;4D!$��i�H �G�I:<\;>�45:<�)%-�"H;4A� >�#2#��]')=-�$H;45!"��i�H �.4R� �"!$V��x� �.��C.�;#��C"';!"=)!"��CU���;i �,�$H;4R!$4rQ #,!"4�� �"H):<�P�$H;4/=):�!$:,%&�+i,3 �$:<\)>+4.��CL:<>�CU#5CU4R�L';= Q #,!�i�4R�)4R!I:B�"��#��q�

� ��� � .\2 � � � � �w'*4>#��(! %g#����v03'*0 ��0G')%���"-# .1# ��' � 0

��H;40�+35=Y#�!"�$:��,�L� ';4ACU�"��#�����C�H;#Btl�$H;40=):<!I:�%&��i�3DC0~ tLH;��(IH�:�!"40CU=Y4A(R�� M4A%DQ #,!�i�4R� �4R!I:B�$�+#,�M�L(A:<�]\Y4 ')C"4A%�Q #�!G:��):<>�V&CU��CA�@?h�):�>+V&C"��CG:<�)%]i�4R�)4R!I:B�"��#���:�!"4/�$H;4K�+�2J�4A!$C"4#<Q94s:�(IH #<�$H;4R!s�PS@';3D:<��4R82=Y4R!"�$C )�)% �+�@4A:,CU��4R!L�$# C"=M4s(r�+Q VOC"#�>�'&�"��#��O�$#D�"H;4 i�4R� �4R!I:B�$�+#,��=;!"#,\;>�4R3 � � �x��C/�"H)4D�$:,C �}#<Q��"H)4 (r#,3K=)'&�$:<�"��#��):�> >��+�;i,';��Cb��~�#��;4 tLH;#,C"4=;!$�+3D:�!"V \):,( �2i�!$#�';�)% ��C5����(r#�35=;';�"4R!�C$(r��4R�M(r4s�x�$# CU#,>+J,4 �$H;4��+�M%&�+!$4A(r�D#�!5�"H)4��� J,4R!ICU4G=;!$#�\;>�4R3 �[12#�>�'&�$�+#,� #<Qq�"H;4.���)%&��!"4s(*��=;!"#,\;>�4R3 !$4A� ';��!"4sC�C"#�354G:�35#�';� ��#<QC"4A:<!I(IHn���H;4A!"4 :�!"4/#��"H;4A!@���)CU�$:<�M(r4ACG#<Q[C"�+35��>�:�!@���2J�4R!IC"4/=;!"#,\;>�4R3 �+�-#<�"H)4R!G%;#�3D:<���)CA�

Sh')35:��)C )�)% �+�D4A:�C"��4R!K�"# C"=M4s(r�+Q V CU#,>+';�"��#�� �"#�#��;4 #�Q@�"H)4O=)!"#,\;>+4A3DC �P(R:<>�>L�+��"H)4K%&��!$4A(*�0=;!$#�\;>�4R3 � f #�!04r8;:<35=;>�4 �YH;#Bt��$# 3 ')>��$�+=;>�V �btP#��+� �$4Ri�4A!$C@��C0: %;�+!$4A(r�=;!$#�\;>�4R3 tLH;# CU4xCU#,>+'&�$�+#,����CG�;4s:B�">�V =;!$#BJ ��%&4s%�� ��H;4x�+�)%;�+!$4A(r�G=;!$#�\;>�4R3 �Y�):<354A>+V%&��J2��C"�+#,� �2\M4R�bt�4A4R���bt�#x�+� �$4Ri�4A!$C��2!"4s� ';�+!$4ACPC"#�3540:�35#�';� ��#<Q�C"4A:�!$(IH � ')C"�+�)ix3x';>���"��=;>���(A:B�$�+#,� ~ �"H;4hC"#�>�'&�$�+#,� �$#.�"H;4h%&��!$4A(*�[=)!"#,\;>+4A3��*�v?�3K#,354R� ��� CT�"H;#,';i�H �[tP#�';>�%!$4RJ�4s:<>��"H):<�.�"H;4535#,CU�7(r#�3535#��)>+V�')C"4A%}%&��J2��C"�+#,� :�>+i,#�!$���$H;3 Q #�!7%&4s(r��35:�>v� ')3 �\Y4R!IC �n:,(*�"'M:<>�>+V����2J�#�>�J�4sC@: �"!$��:�>9:<�)% 4R!$!"#,!x~ CU4s:<!I(IHM�@:<�04s:�(IH}Cb�$4R= �z�$#�#,\&�$:��+�}:C"�+�;i,>+4�%&��i��+�TtLH)��(IHx��Cv=):�!U�v#<Q)�"H;4�:<�)C"tP4R!s� � X@�$H;4R!v4R8&:�35=;>+4sCq#�QM���2J�4R!IC"4 =;!$#�\;>�4R3=):��+!IC/:<!$4K�bV ���;i�:��2�;#<�7:��)%}';� �bV ���;i �+���v(r>��+3x\;�+�)i]:�>�:�%)%&4R!/';= :��)%}(r>��+3x\;�+�)i%&#BtL� �;%;���z4R!$4R� �"��:B�$�+#,�O:��)%O�+� �$4Ri�!I:B�$�+#,� �24R�)(R!"V2=&�$�+#,�O:��)% %&4A(R!"V2=&�$�+#,� �&4r�I(<�

pn4R�x')CK�;#Bt #,'&�">����;4O:-354r�"H)#2% \):�C"4A% #�� C"4A:�!$(IH #�Q@=):�!$:,%&�+i,3 �I:<\;>�4ACxQ #,!%&#,�+�;i/35#,!"=;H)#�>�#�i���(R:�>&:<�):�>+V&C"��CA�T12')=;=M# CU4hQ #�![4R8&:�35=;>+4��<tP4@:<!$4�i���J�4R���B:<=M:�G#,_:<�M%�:<!$4 :�C ��4s%O�"# )�M%����IC@!$#2#<�G:��)%OQ 4A:<�"';!$4 JB:�>+';4sCR�h?GC"C"';3547Q ')!U�$H;4R!G�"H):<�@tP4H): J,4T#,�;>�Vh�btP#L=):<!I:�%&��i�3u�$:<\)>+4sC�Q #�!q>�: G:�� :,:P=):<!I:�%&��i�3 :<�)%0\;H):,:,1&:,:P=):<!I:�%&��i�3~ f ��i�';!$4 W)� �2�*� ��H;4 )!$CU�qCU�"4R=/��C��$#@C"4R49tLH;4R�"H;4A! �B:<=): @# _ #2(A(r';!ICn:,Cn:<�/���)%&4s(r>��+���:<\)>+47tP#�!I%�� ��H;��C@(IH;4s( � tP#�';>�% \M4 =M4A!UQ #,!"354A% #,��:�%&��(*�"��#��M:<!$V #<Q9���)%&4s(r>��+�):�\;>�4tP#�!I%;C �2tLH;��(IH�CUH)#�';>�% \Y47: JB:<��>�:�\;>�4.C"4R=M:<!I:B�"4A>+V,���H;4��;4r82�9Cb�$4R= ��C��"#.(IH;4A( �/:�>+>,�"H;4P4R� �$!"��4AC��+�5:<>�>,�"H;4P=):<!I:�%;�+i,3 �I:<\;>�4AC�H): J2���;i

�"H)4/>�:,Cb�h(IH):�!$:,(*�"4A! _ �)�+�O�"H)47CU'��58�� ��H;4R!$4.H):<=)=M4A�)C��"#D\Y4/�;#,�;4����H;40�;4r82�LCb�$4R=O��C��$#K(IH;4s( �D:<>�>M�$H;404R� �"!$�+4sCP�+�O:<>�>M�$H;40�$:�\;>+4sC��"H):<�PH): J,4 #,_ �

:�CP�$H;47C"'��58�Cb�$!"���;iM� ��H;4R!$40�"';!$��#,'&�L�"#D\Y4.�btP#x4A�,�$!"��4ACA� ��H;4AV :<!$4��T S �¤Á Ã�Á ½ �¢Â¢Ä ½ Ç�ÈWÂ�Ç�×>Á ��Ä Ò*ÁkÂ/Ã�Ê Ç1À�Ç�Ñ¢ÄÉÍ/×>ÁkÃ!�¢Ê�Í/Ê�Ë@Ô�ÁpÇ�À ½ �¢ÄÉÂ��TË Ê�ÀNÇ�Â/Ä Ã�Ák×eÄÉÂ/Ç\Ô�Ê�À�Ã�ÁkÍoÈÉÄÉÔ�ÃÄÉÔ M ?BL I��WH\AWEOI����-C)Ï� S �¤Á1Ô�ÁpÇ�À ½ �`Ô�Ã�ÁkѱÄÉÂ�Ò*Ê�È Ò*ÁkÔc×6Ó¢È Ã�ÄÉÑ¢È Õ)ÄÉÂ��\à �¢Á\ꢀ Ò)ÄÉÔ�Ê�À��*Õ`ÇSÔ�ÄÉÂ���ÈÉÁ1ꢀ ��Ä ÃMÃ�Ê Q¢Â¢Í`Ã!�¢Á\ÈÎÇ�À ��ÁkÔ�ÃÔ�Ó ½ � ꢀ ��Ä Ã��cÄ Ã!�¢Ê�Ӥà Á-V ½ ÁkÁpͤÄÉÂ�� à �¤ÁSÇ�ѤѢÀ�Ê�Ñ¢À�ÄÎÇ´Ã�ÁkÈ ÕoÔ�Ä �kÁkÍ ÈÉÁPË�Ã�×>Ê�Ô�ÃMÑ�Ç�À�ÃcÊ�ËQÃ!�¢Á1ꢀ Ò)ÄÉÍ¢Ák¢ÍWÏ

Page 52: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,y ������� ��� � � ���� ������� ����� �� ������ �� � �

| #,!$% Q #�!$3DCP�$:<\)>+4.Q #,!L\;H):�: 1&:�:� ¢��

� �Q� � �*� ��{~� ����} �s� � {������12���;i�';>�:<! \;H):,:,1&:,: \;HM:�:,1;:�:Z[>�';!I:<> \;H):,:,1&:,:<4A_ \;HM:�:,1;:�:<# _

Z9:�!$:,%&��i�3 �$:�\;>+4.Q #,!L\;H):,:,1&:,:� ���

� �Q� � ��� ��{~� ����} � � � {������12�+�)i�';>�:<! ~�y � �z� ~�y � �z�Z[>�';!$:�> ~�y �&4s_-� ~�y �&#,_-�

f �+i,';!"4/W)� � �T|}#�!I% Q #�!$35CL:��)%�=):<!I:�%&��i�3��I:<\;>�4.Q #�!L\)H):�: 1&:�:��� >�: G:��B:�:x=):<!I:�%&��i�3��I:<\;>�4 �h~b���&#,_-���� \;H):,:,1&:,: =):�!$:,%&��i�3��$:�\;>�4 �h~�y �&# _-�

f #,!�4s:�(IH #<Q7�$H;4�4R� �"!$�+4sC �0:�%;% :�C�3D:<�2Vu(IH):<!I:�(r�"4A!$C�:�C :<!$4 C"H;#BtL�lQ !$#�3�"H)4]!"#2#��5#�QG�$H;4]=):�!$:,%&��i�3��$:�\;>�4��d|}4]i,4r�D�btP#}!$#2#<�IC�� :�=):�0:�:�:��)% � :�=):�!$4AC"=M4s(*�"��J�4A>+V,� ��H;4sCU4x(R:<�-�;#Bt \M4K(IH;4A( �,4A% ���]�$H;4x%&��(*�$�+#,�):<!$VO#<Q[!$# #��$Cx~ f �+i,';!$4W;� W,�r� ��H;4hQ #,!"354R!P#&(R(R';!$C����D�"H;4.%&��(*�$�+#,�):<!$V��v� ����CP�;#Btu(IH;4s( ��4A%5tLH)4r�"H)4R!�����H):,C�"H)4�C$:<354[=):�!$:,%&�+i,3d���7tLH;# CU49�I:<\;>�4[�+�$CTCU' �K8/H):,Cn3D:B�I(IH;4A%n��?@Cq�"H)4�(IH;4s( �h�"')!"�)C#�';�x�$#-\Y4��$!"')4 � �B:<=): G:,:]��CK��%&4A� �"� )4A% :�C �"H;4O!"#2#��A� c0!$:�3535:<�"��(R:�> Q 4s:B�"')!"4sC:�C$C"#2(R��:<�"4s%]tL�+�"H �B:�=):�0:�: ���+� �"H;4�%;��(r�"��#��):�!"V]#�Q�!$#2#<�$C/:��)% tL���$H�C"'��58 #,_ ���� �$H;4�=M:<!I:�%&��i�3 �$:�\;>�4��$#�i,4r�"H)4R!5(r#��MCb�$���$'&�"4�:<� :<�)C"tP4R! ~ #�!D: >+4R8&��(A:<>P4R� �"!$V;�Q #�!� � :�=):�G#,_ �+� ��H;4.CUV&CU�"4A3 (r#�� �$�+�2';4sC�C"4A:�!$(IH;���;i/Q #,!P:,%;%&�+�"��#��):�>�CU'��58&4ACPC"')(IH:�C #,_ � � :,%&#,_ �T4R�$(�� ����(R:�C"4 :�%;%&�+�"��#��M:<>L:<�)C"tP4R!ICx:�!"4 Q #�';�)% ~ �)#��;4 ��� �$H;��C4r8;:�3K=)>+4 ���$H;4RV7tP#�')>�%x:<>�CU#0\M4�!$4r�$';!"�)4A%�� f ��i�')!"4�W;�F�@C"H;#BthC��+�)=;'&�$C9:��)%x#�'&�$=;'&�$C�"#535#�!$=;H;#,>+#,i���(R:�>z:��):<>�V2wR4A!A�v?h>�i�#,!"�+�"H;3�W;� Wxi,�+J,4AC��"H)4/4r8;:�(r��=)!"#&(r4s%&';!$4��� ¦ ��µ�����§¤� � o � o _�#,!"=;H)#�>�#�i���(R:�>Y:��):<>�V&CU��C�')C"�+�)iK=M:<!I:�%&��i�3��I:<\;>�4ACA�° ¥ �¤¬Sµ��¤­ �q#5��%&4R� �$��Q V�!"#2#<�h:��)%Oi�!I:<353D:B�"��(R:�>)Q 4s:B�$';!"4sC�#<Q9:Ki���J�4R�OtP#�!I%��·*  ¬G¥ § ?�t�#,!$% t� ¥ §�¬3¥ § ?{CU4R� #<QL>�4r8&��(A:<>�4R� �"!$�+4sC7p ~�tLH;4R!$4�4A:,(IH�>+4R82��(R:�> 4A�,�$!"V}Cb�I:<�)%)C/Q #�!x:

!"#2#<�L:<�M%��+�$Chi�!I:<353D:B�"��(R:�>)Q 4s:B�$';!"4sC$�� �)­@� Z9:<!I:�%&��i�3 �I:<\;>�4AC�� @��(*�$�+#,�):<!$V�#�Q�!$# #��$C 0g � G��(r�"��#��):�!"V�#�Q����)%&4s(r>��+�):�\;>�4

t�#,!$%;C G�*�

Page 53: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� �� �� �� �� � �������� ������ �� � � � � � ��� � � �������� � ��� �M�

��'�� ����� � � ���" ����� � � " � �!���� �

� '����

���� " )�� � �� '���� ��' " '��� � � "

� '���� �'�� �������� " �����& " ���� � �!� '������)

'�� ��' '�� ���� � �!� '������)

����& " � �� ���!����� ��

f ��i�';!$4/W;�F� �9_�#,!"=;H)#�>�#�i���(R:�>Y:��):<>�V2wR4A!P���;=;';� � #�'&�$=;'&�

� ¦ ��µ�����§¤� ����Lp � ��4R35=&�bVOCU4R�E&��� Qvt ��C��+� G��tL�+�"H 4A�,�$!"V \��$H;4R��:,%;%O\��$#Dp[�W;�PQ #�!L� � � yK�"#5>+4A�;i<�$H #<Q�t�%&#

>�4r�@C�� CU'��58O#<Q�>�4R�)i<�"H �n���OtQ #�!@4A:�(IH�=):<!I:�%;�+i,3 �$:�\;>+4/Z

Q #,!L4A:,(IH 4R� �$!"V�\ ~ (r#��MCU��Cb�$�+�)iK#�Qv:K=):��+!*���+��Z�%&#�+QvC � CU'��58O�+� 4R� �$!"V�\O�$H;4R�\Y4Ri���� !���!$# #��L#<Q�=M:<!I:�%&��i�3 �I:<\;>�4/Z a � �2';3 \Y4R!�#�Q�(IH):<!I:�(r�"4A!$C[�"#K\M4/%&4A>+4R�"4A%O:�CPC"H;#BtL� ���\

=;!"#,=M# CU4s% � !"#2#<� � ~ t �YC"'��58/C$� C"'��58G#�Q2!T(r#,�)CU��CU�"���;i#<Q)aL(IH):�!$:,(*�"4A!$C

� Qz~�=;!"#,=M# CU4s% � !"#2#<����C���� Gg@�n:<�)%5~ �$H;4[!$#2#<�nH):,C�=):<!I:�%;�+i,3Z���"H;4A��(R#��)CU�"!$')(r�D:}>�4r8&��(R:<>L4A� �"!$V >h\2V (r#,3 \;���;���;il~�: �Q 4A:B�$';!$4AC/i,�+J,4R� ��� Gg tL���$H �"H;4 =;!"#,=M# CU4s% � !"#2#<� ��:��)%~ \M��Q 4s:B�"')!"4sCL:�C$CU#&(r��:B�$4A% tL���$HO4,�

?@%;%O>��$#5C"4r�@p4R�M% #�QT\Y4Ri,�+�

4A�)% Q #�!L4RJ,4R!$V�4R� �$!"V�����Z4R�M% Q #,!L4RJ,4R!$V�=):<!I:�%;�+i,3

Page 54: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� E ������� ��� � � ���� ������� ����� �� ������ �� � �

4R�M% Q #,!L4RJ,4R!$VD��)��� Q9p���C�4A3K=;�bV

�"H)4R� !"4R�"';!$� �U';� �2�;#BtL�OtP#�!I% t 4R>�C"40!$4r�$';!$��~ p��

�   ª��E¦ ��µ�����§¤� �

� ��� |2�,/, ��')%�� ��2 � .\2 � � ��� �w'*4>#�� ! %g#����v03'*0�� �� � 2(' �*# 51' �8%��

��H;4K354r�"H)#2% #�';�">��+�;4s%]��� ?@>+i,#�!$���$H;3 W;� WDQ #,!035#,!"=;H)#�>�#�i���(R:�>q:<�M:<>�V2C"��C@��C.�,')���$44r8&=Y4R�)C"��J�4]���u�$�+354�� 6 :,(IHl4R� �"!$V ���u4AJ�4R!$V =):<!I:�%&��i�3 �$:�\;>+4 ��COC$(R:<�)�;4A%l:��)%(r#,35=):<!$4A%DtL�+�"HO4RJ,4R!$V5=M# C"C"�+\)>+4.CU' �K8DQ #,!L:7i���J�4A� tP#�!I%�� ��H;��C�C"4A:�!$(IH (A:<� �$:��,4: >�#��;i �$�+354��O� �7�$';!"�MC/#�'&� �"H):<�7�"H;4�CU4s:<!I(IH}(A:<��\M4�CU=Y4R4s%&4A%�';= 4A�;#�!$35#�')C">�V\2V :<�):�>+V2wA�+�;i-�"H;4O=):�!$:,%&�+i,3 �$:<\)>+4sCK:��)% �$H;4O�+�&Q #,!"3D:<�"��#�� (R#�� �$:��+�)4A%��$H;4R!$4R���\Y4rQ #�!$4RHM:<�)% �,:<�)%Ki�4A�;4R!I:B�$�+�)i0:��;#<�$H;4R!T�$:�\;>�4L#�!9%;:B�I:.Cb�$!"')(r�"';!$4LCU')���I:<\;>�4�Q #�!v�$H;��CC"4A:<!I(IHn����H;��C7=;!$#&(r4AC$C/��C (A:<>�>+4s%}(R#�35=;��>�:<�"��#��n�-XG�)(R45�"H;4��;4Rt %;:<�$:]CU�"!$')(r�"';!$4��C/i�4A�;4R!I:B�$4A% ����� ��C/')C"4A%}\2V]�$H;4�35#�!$=;H;#,>+#,i���(R:�>v:��):<>�V2wR4A!��T:<�)% �"H)4D=):<!I:�%&��i�3�$:�\;>�4ACL:<!$4.�;#D>�#��;i,4R!��;4R4s%&4A%n�h~ 124A4 f ��i�')!"4/W;� ^,�r� f #,!��"H;47(R#�35=;��>�:<�"��#��O=;!"#&(R4AC$CQ #�!7:O>�:<�;i,'):<i,4 �$#�Cb�I:<!"���q:�>+>v�$H;4D=):<!I:�%;�+i,3 �$:<\)>+4sC.3 ')CU�7\M4�: JB:��+>�:<\;>�4xQ #�!.�"H)4>�:<�;i,'):<i,4����H;4 %):B�$:DCU�"!$')(r�"';!$47tP4 CUHM:<>�>�%&4sC"(R!"��\M4 �;#Bt ��Ch\M:�C"4A% #�� �$H;4 C"#�!"�"4s% >+��Cb�G#<Q

C"'��5824sChQ !$#�3��"H)4x=):�!$:,%&��i�3��$:<\)>+4sC ~�(A:<>�>��+�/CU#,!U�$4A% !$4RJ�4A!$C"47C"'��58O�I:<\;>�4s�r� ��H)4(r#,35=;�+>�4R!��I:��,4ACL:<>�>��$H;4/4R� �"!$��4ACPQ !$#�3�:�>+>z�$H;4/=):�!$:,%&�+i,3 �$:�\;>�4AC��):<�)%�!$4A:<!$!I:<�;i,4AC�"H)4R3 :BQ �"4A!@C"#�!"�"���;i5#�� �"H)47!"4AJ�4A!$C"4G#�QvC"'��58&4ACA� ��H2')C��&�$H;4/�$:�\;>�4/�+� f ��i�';!$47W;� etP#�';>�%�\M4 i�4R�)4R!I:B�"4s%}��QhtP4DH):�%�#,�;>�V-�btP#�=):<!I:�%;�+i,3 �$:�\;>�4AC/Q #,!7>�:�0:��B:�:�:��)%\;H):,:,1&:,: ��� #�';!L>�:<�)i�'):�i�4��

XG�)(R4.�"H;4/�I:<\;>�4/��� f ��i�')!"47W)�Fe ��Chi�4A�;4R!I:B�$4A% �2�$H;47#,!"��i����):<>�=M:<!I:�%&��i�3 �I:<\;>�4AC~ #�Q f �+i,';!"4GW;� � �9:�!"4h�)#7>+#,�;i�4A! �;4A4A%&4s%�� ��H;4h�btP#/�I:<\;>�4AC H): J�4L4R8&:,(*�$>+VK�"H)4GC$:<354���&Q #�!$3D:B�"��#��q� |lH):B�D��CK%;���z4R!$4R� �5��Cx�"H)4R��!D#�!$i,:<�)�+ws:B�"��#�� tLH)��(IH ��CK!$4AC"=M#,�)CU��\;>�4Q #�!G�"H)45C"=Y4R4A%-';=n� ��H;4 ��4AV ��%&4s: 'MCU4s%]H;4A!"4x��CG�"HM:B�.�"H;45C"'��5824sCG:�!"4x#�!I%&4R!$4A%n���H;4A!"4RQ #�!$4 �9i���J�4A� : C"'��58 #<QG:-i���J�4A� t�#,!$% �T�+��(R:�� \M4O>�#2(A:B�$4A% J,4R!$V�� ';��( �2>+VtL�+�"H;#,'&�@C"(A:<�;�)�+�;iD:�>+>�4A�,�$!"��4AC�����:<>�>z�"H;4/=M:<!I:�%&��i�3��I:<\;>�4ACA�

� �D��CD�"H;4�C$:<354�C": J2���;i ��� �"��354�#��;4 #�\;�$:<���)CK����C"4A:�!$(IH)�+�;i Q #�!�:}tP#�!I% ���: H2';3D:<� � !$4A:,%;:<\;>�4-%&��(*�$�+#,�):<!$V tLH)4R�l�$H;4 4A� �"!$�+4sC :<!$4]���d:<>�=;H):�\M4R�"��(R:�>@#�!I%&4A!J�4A!$C"')CG�+�}:<!$\;�+�"!I:<!$V�#,!$%&4A!A�/?@>+i,#�!$���$H;3 W;� � i,�+J,4AC@�"H;4K4r8;:�(r�.%;4r�$:��+>�C������/CUH)#�';>�%\Y47(r#�35=):�!"4s%�tL�+�"H]?@>+i,#�!$���$H;3{W;� WK\2VD�"H;4/!$4A:,%&4R!s�� ¦ ��µ�����§¤� � o � � _�#,!"=;H)#�>�#�i���(R:�>�:��):<>�V&CU��C 'MCU���;i�CU#,!U�$4A% !$4RJ,4R!ICU4OCU' �K8 �I:<\;>�4��

~ ��#�35=):�!"40tL�+�"H�?h>�i�#,!"�+�"H;3 W;� W,���� S �¢ÄÉÔ\Ô�Á ½ Ã�ÄÉÊ�Â8À�Á * Ó¢ÄÉÀ�ÁkÔTÇ ��À�ÁpÇ´Ã�ÁkÀ �¢Ç ½ Ø ��À�Ê�Ӣ¢ͩÊ�Ë ½ Ê�×>Ñ¢Ó)Ã�ÁkÀTÔ ½ ÄÉÁk ½ Á/Ç�¢Íw×/ÇkÕ��Á>Ê�ѤÅÃ�ÄÉÊ�Â�Ç�ÈÉÈ ÕoÔ�Ø�ÄÉÑ¢Ñ�ÁpÍsÏ

Page 55: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �� � �� ������ ����� � �� �� �� � �������� ������ �� � � ���)� ��� � � �� � ���������"� W

��

� ���

� '����

��& �

� � � � � " � ����� � �

���� " ) � � � '�������' " ' �� � � "

���& " � � '�����'�� � ������ " � �# � � ����'�����)

'�� ��' '�� �# � � �!� '������)

#

� � � ������� ��!� ��� ������� #

� '������ " � �

� ��������� �� ����& " ���

� '��� � '���� ������& " � � ' '����

� � �� �!����'��� ��& " �� ���!����� ��

f �+i,';!"4/W)� ^ ��~ :,�h��#,3K=)�+>�:B�$�+#,��#�QT=):�!$:,%&��i�3DC ��~�\M��_�#�!$=;H;#,>+#,i���(R:�>Y:��):<>�V&CU��C

� ����� � % �% �����

���C� � ������� �% � ��� � � � �! � �����C�� � � � � ����/��� � ��� �

� � � ��� � �@� ��������� � � � %"! � � �! � �$# �@� % � # �8� � � �%� � � � �C�'& ( � � �)�(��* �����

! � ��� ���/�� ��� � � � � � � � ������/� � �$� � � �'&

+ + 4-, <.,/&('�)*'�+�',' 5 &('�4�4 & '�)1'�+�','+ + 4-, <.,/F0/J',' 1C'�' F2/J'�'�18','+ + 4-, .3,JF2//',' 1C',' F2/J'�'�18',' 4�?? 4 4-, .3,J&('�)1'�+,'�' & '�)1'�+,?14�?? 4 D5, <5,8&('�)1'�+,'�' & '�)1'�+,?H�? + D5, <5,8F2//','�18',' F2/J'�'�18','�?�HH�. 4 D5, .0,C& '�)1'�+�',' & '�)1'�+,. H 4�?H�. + D5, .0,CF2/J'�'�18',' F2/J'�'�18','�.BH 4�?

f ��i�';!$4/W;� e �[12#,!U�$4A%�!"4AJ�4R!IC"40C"'��58��$:�\;>�4

Page 56: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� ������� ��� � � ���� ������� ����� �� ������ �� � �

° ¥ �¤¬Sµ��¤­ �q#5��%&4R� �$��Q V�!"#2#<�h:��)%Oi�!I:<353D:B�"��(R:�>)Q 4s:B�$';!"4sC�#<Q9:Ki���J�4R�OtP#�!I%��·*  ¬G¥ § ?�t�#,!$% t� ¥ §�¬3¥ § ?{CU4R� #<QL>�4r8&��(A:<>�4R� �"!$�+4sC7p ~�tLH;4R!$4�4A:,(IH�>+4R82��(R:�> 4A�,�$!"V}Cb�I:<�)%)C/Q #�!x:

!"#2#<�L:<�M%�i,!$:�3535:<�"��(R:�>MQ 4s:B�$';!"4sC$�� �)­@� 12#�!"�"4s%O!"4AJ�4R!IC"40C"'��58 �I:<\;>�47g@1 ��� G��(*�"��#��M:<!$V�#<Qv!"#2#��$C�0g ��G��(r�"��#��):�!"V

#<Q����)%&4s(r>��+�M:<\;>�4/t�#,!$%)C G�*�� ¦ ��µ�����§¤� �

���Lp � ��4R35=&�bVOCU4R���E&��� Qvt ��C��+� G��tL�+�"H 4A�,�$!"V \

�"H)4R��:�%;%O\O�"#DC"4r�@p �W;�PQ #�!L� � � yK�"#5>+4A�;i<�$H #<Q�t�%&#

>�4r�G1 � C"'��58�#�QT>�4R�;i��"HO�n���Ot�+Qv!$4RJ,4R!ICU4 ~�CI�[��C���� gG1 ��"H)4R� Q #�!L4s:�(IH�4R� �"!$V�\�:�C$CU#&(R��:<�"4A%�tL�+�"H !"4AJ�4A!$C"4,~ C$� �+� g@1 � %&#\Y4Ri����

=)!"#,=M# CU4s% � !$#2#<� � ~ t �qC"'��58KCI� lCU�"!$�+�)iG�$#/\M4h:,%;%&4s%7Q !$#�3!$#2#<��+Q ~ =)!"#,=M# CU4s% � !$#2#<�[��C[��� %&��(*�$�+#,�):<!$Vx#�Qn!"#2#��$CI�9:<�)%�~ �"H;40!$# #��HM:�C�=):�!$:,%&�+i,3��bV2=M47Z ���O\Y��$H;4R� (r#,�)CU�"!$')(*�7:O>+4R8&��(A:<>94R� �$!"V]> \ V (r#�3x\;���;�+�)i�~ :,�GQ 4s:B�"')!"4sCi���J�4A�}Q #�!/�$H;4�=;!$#�=Y#,C"4A%}!$# #��7�+� 0g �T:<�)%l~�\M�.Q 4s:B�"')!"4sC:�C$C"#2(R��:<�"4s%�tL�+�"H \n�

:�%)% >��$#Dp4R�M%�#�QT\Y4Ri,�+�OQ #,!L4A:�(IH�4R� �"!$V

4R�M% Q #,!L��)��� Q9p���C�4A3K=;�bV��"H)4R� !"4R�"';!$��~ �U')� �2�;#BtL��tP#�!I%�t ,��4R>�CU4.!$4r�$';!"��~�pT�

�   ª��E¦ ��µ�����§¤� �

� ��� � .\2 � � � � �w'*4>#��w!Z%g#�� ��>,/.�� � ,�! � ��'�51' �w%g#��� 0G0 �g,o0 �

��� S �¢ÄÉÔ\Ô�Á ½ Ã�ÄÉÊ�Â8À�Á * Ó¢ÄÉÀ�ÁkÔTÇ ��À�ÁpÇ´Ã�ÁkÀ �¢Ç ½ Ø ��À�Ê�Ӣ¢ͩÊ�Ë ½ Ê�×>Ñ¢Ó)Ã�ÁkÀTÔ ½ ÄÉÁk ½ Á/Ç�¢Íw×/ÇkÕ��Á>Ê�ѤÅÃ�ÄÉÊ�Â�Ç�ÈÉÈ ÕoÔ�Ø�ÄÉÑ¢Ñ�ÁpÍsÏ

Page 57: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� � ���� � �� �� �������� ������ ���� � ��[� � � � ��� �������������� '� � ���!� � �"�2���H;4A!"4K:<!$4 :<>+�"4A!"�):<�"��J�4sCL�"# �"H;4KCU#,!U�$4A%�!$4RJ,4R!ICU47C"'��58 �$:�\;>+45%;:<�$:�CU�"!$')(*�$';!$4��.?3D:Bab#,!v:�>��$4R!$�):B�$�+J,4���Cv�$H;4L')C"4P#�Q)�$!"��4ACA� �E��{ �*� :<!$4P�"!$4R4sCv�+�5tLH;��(IH �,4RV&Cv:<!$4LCb�$#�!$4A%�����$H;47=):<�"H�CU�$:<!"�"���;iKQ !$#�3{!$#2#<�L�;#&%&4��):<�)%O�;#��h�+� �$H;4/�;#&%&4sC��"H;4A3DCU4A>+J,4ACA� f #,!4r8;:�3K=)>+4�� f ��i�')!"4KW;� � C"H;#BthCh�$!"4A4K:��)%��$!"��45Cb�$!"')(r�"';!$4AC@Q #�!0�$H;4x!$4RJ,4R!ICU4xCU'��58&4ACQ #�!�>�: G:��B:�:/:<�M%D\;H):,:,1&:,:.=):<!I:�%&��i�3DCvQ !$#�3 f �+i,';!$4@W;� e2� f #,![�"H)4hQ #�')!�%&� �Y4A!"4A� �

'�����

���

� �

��& �

��� �

'�

f ��i�';!$4/W;� ���L~�: �hXG!$%;4R!$4A%�\)�+�):�!"V��"!$4R4/:<�)%}~ \Y���q!$��4.CU�"!$')(r�"';!$4ACC"'��5824sC��"H)4R!$47:<!$4.Q #�';!h�)#2%;4ACh���O�"H;4 \;�+�M:<!$V��"!$4R4�~��+� f ��i�';!$47W;� ��~�: �U� �;�"HM:B�@��C �#��)404s:�(IH�Q #�!h:5%&��Cb�$�+�M(*�GC"'��58�� �

��� �"H)47�"!$��4 CUH)#BtL���+� f ��i�';!$4 W)� �M~ \M� �M:<>�>T=M# C"C"�+\)>+47=M:B�"HMC@CU�$:<!"�"���;iDQ !$#�3��"H)4!$# #�� �;#&%&4}:<!$4 � � �M4 � �M_ � �Y_�4�� �Y_�#M� +�X@Q/�"H;4sCU4��h#��;>�V Q #�';!�3D:<! ��4A%�\2V� �zCU�$:<�M%OQ #�!@C"'��58&4ACA�L���&Q #�!$3D:B�"��#�� !$4Ri :<!I%&�+�)iK=M:<!I:�%&��i�3 (r>�:�C$C �Mi�!I:<353D:B�"��(R:�>Q 4A:<�"';!$4AC��94r�I(<�l~�C$:<354O:�Cx�+� f ��i�')!"4OW;� e<�7(A:<� \M4 :�C$CU#&(R��:<�"4A%�tL�+�"H � �v#�!x�"H)4C"'��5824sC��+�O�$H;4.�"!$�+4,���!"��4ACz=Y4R!$35���q!I:<=)��%03D:B�I(IH;�+�)iL#<Q2=):<!"�"��:<>�C"'��58&4ACA� f #,!n4r8;:�3K=)>+4��A�+Q >�:�0:���# _ �tP#�!I%���CP�"#5\M47:��):<>�V2wR4s% �2#��;4/(R:���\Y4Ri,�+�O\):,( � t�:<!I%;C Q !"#,3 �"H)40tP#�!I% �&3D:B�I(IH;���;i

(IH):�!$:,(*�"4A! \2V (IH):�!$:,(*�$4R! �����"H;40�"!$��4��96 :,(IH��"��354/: � �&35:�! �5��C�4R�)(R#�';� �$4R!$4A% �2�+���CP:xJB:<>���%�CU' �K8DQ #,!PC"#�3540!"#2#��A�9?P�P4s:�(IH C"')(IH�=M#,�+� ���;: !"#2#��P��C��"#K\M40=;!$#�=Y#,C"4A%:<�M%�(IH;4s( ��4s% ���O�"H;47%&��(*�$�+#,�):<!$VD#<Qv!$# #��$CA�

� � ÔEÔ �¢Ê �c ÄÉÂSÐEÄ ��Ó¢À�Á��¤Ï �" Ç $ ��Ç�Â6Ê�À�Í¢ÁkÀ�ÁkÍ��¤ÄÉÂ�Ç�À�Õ\Ã�À�ÁkÁ ��Ç�ÔEà �¢ÁMÑ¢À�Ê�Ñ�ÁpÀ�Ã~Õ\à ��ǴëÇ�ÈÉÈ)Ã!�¢ÁM¢Ê�Í¢ÁkÔÄÉÂ>à �¤ÁGÈÉÁPË ÃlÔ�Ó��>Ã�À�ÁkÁGÊ�Ë@Ã!�¢Á3À�Ê)Ê�Ãl¢Ê)ͤÁ ��ÇpÒ*ÁGØ�ÁkÕ)Ô " Ô�Ó��[V)ÁkÔ%$�Ã!��Ç´ÃMÊ ½p½ Ó¢ÀcÇ�ÈÉÑ��¢Ç�� ÁPÃ�Ä ½ Ç�ÈÉÈ Õ � ÁPË Ê�À�ÁÃ!�¢Á6Ø�ÁPÕ ÄɱÃ!�¢ÁTÀ�Ê�Ê�ÃKÏ " Ð�Ê�À3ÁWV¤Ç�×>Ñ¢ÈÉÁ����8Ç�¢Í&ÁSÊ ½k½ Ó¢À���ÁkË Ê�À�Á �±Á $PÏ��)ÄÉ×>ÄÉÈÎÇ�À�È ÕoÇ�ÈÉÈEØ�ÁPÕ¤ÔGÄɱà �¢Á¢Ê�Í¢ÁkÔ6ÄÉÂwÃ!�¢ÁoÀ�Ä ���*ÃTÔ�Ó��¤Å Ã�À�ÁpÁ/Ê�Ëcà �¤Á`À�Ê)Ê�ÃS¢Ê�Í¢Á/Ê ½k½ Ó¢À>Ç�ÈÉÑ��¢Ç�� ÁPÃ�Ä ½ Ç�ÈÉÈ Õ Ç´Ë�Ã�ÁkÀ\à �¢ÁoØ�ÁPÕ©ÄÉ à �¢ÁÀ�Ê�Ê�ÃpÏ " Ð�Ê�À ÁWV¢Ç�×>Ñ¢ÈÉÁ�� �±Ê6Ê ½k½ Ó¢À�ÔGÇ´Ë Ã�ÁkÀ �±Á�Ï $ S �¢ÄÉÔcÑ¢À�Ê�Ñ�ÁkÀ�Ã~Õ �¢Ê�ÈÉÍ¢ÔMË Ê�ÀcÀ�Ê�Ê�Ã�ÔGÊ�ËEà �¤ÁTÔ�Ó��¤Ã�À�ÁkÁkÔÇ�¢Í`Ô�Ê Ê�ÂWÏ, �8ÄÉÔGÃ!�¢Á6Ák×>ѤÃ~Õ Ô�Ã�À�ÄÉÂ���� �¢Ä ½ � ѤÀ�ÁWQ�V)ÁpÍ&Ê�À3Ô�Ó��[V)ÁkÍ �cÄ Ã!�&Ç�Â�Õ±Ê�à �¢ÁkÀ ½ �¢Ç�À Ç ½ Ã�ÁkÀ1Ê�À3Ô�Ã�À�ÄÉÂ��ÈÉÁpÇpÒ*ÁkÔcÄ Ã Ó¤Â ½ ��Ç�Â���ÁkÍWÏ S �)Ó¢Ô �"X ��Á�Y¤ÄÉÔMÔ Ç�×>Á3Ç�Ô X Á�YÉÏ

Page 58: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,^ ������� ��� � � ���� ������� ����� �� ������ �� � �

? �2';3x\M4A!@#�Q[J :�!"��:B�$�+#,�)CL#,���"!$�+4sC@:�!"47=Y#,C$C"�+\;>�4��.XG�;4 (R:��]\;';��>�% �"!$�+4sCLQ !$#�3>�4rQ �@�$# !$�+i,H �@!$:<�"H;4A!h�$H):<�]\M:�( �2tP:�!$%)CR�����-C"')(IH]: (A:�C"4 �)�"H;4K!"#2#��$CLtP#�';>�%�\Y4 ����"H)4��"!$�+4,�v12' �K8&4sC9(r#�!$!$4AC"=M#,�)%&���;ih�$#/4A:�(IHx=):<!I:�%;�+i,3 (r>�:�C$Cvt�#,';>�%x\Y4�CU�"#,!"4s% ���5:C"4R=):�!$:<�"4h�$!"��4 �&tLH)��(IHOt�#,';>�%�\Y40>���� ��4s%D�"#D:�>+>Y�"H)40!$#2#<�IC�\Y4R>�#��)i����;i �$#K�"H;4/C$:<354=):�!$:,%&�+i,3 (r>�:�C$C/~�C"4R471&:��;i,:�>[~b�A�,�;� �9Q #,!h%&4r�I:<��>�CI�*���H;4}35#,CU�O��35=M#,!U�I:<� ��Q�:,(*�$#�!�%&4r�$4R!$35�+�;���;i tLH):B�](IH;#,��(R4]�$# 3D:���4-��CO�"H)4

: JB:<��>�:�\;��>+�+�bV #�Q[35:��+�-3K4A35#�!$V�� ��!"��4ACG%&#��;#��GtP#�! � tP4R>�>�#,�]CU4s(r#��M%;:<!$V�CU�"#,!$:�i�4C"')(IH�:�Ch%&��C �2CA� � Q9J,4R!$V >�:<!$i�4/:<35#�')�,�h#�QT3D:��+��354R35#,!"V���C@: JB:��+>�:<\;>�4D~�C$: V �&�$4R�)C#<QG3K4Ai,:�\ V �$4ACI�/�$H;4�=)!"4 ;8 �"!$�+4sC5(R:<� \M4 ')C"4A%n� XG� �$H;4 #<�"H)4R!5H):<�M% �[�+QG3D:<���354R35#�!$VD: JB:<��>�:�\;>+4@��C�>+��35���$4A%}~�C$: V �,�"4A�)C[�$#xH2';�M%&!"4s%;C�#<Q �2�+>�#�\2V �"4sC$�9�"H;40!$4RJ�4A!$C"4C"'��58O�$!"��4AC0(R:��]\Y4 �,4R=&�0�+� 35:��+�-3K4A35#�!$VOtLH)�+>�4 �$H;4x%;��(r�"��#��):�!"V #<Q[!$#2#<�IC@(R:��\Y47Cb�$#�!$4A%�#����"H;47%&��C �Y�

f #,![:.>�:��;i�'M:<i�4�C"')(IHD:�C9Sh���)%&�MtLH;��(IHKHM:�C[:.C"�+35=;>�4h35#�!$=;H;#,>+#,i�V �<:0Q 4At �$4R�)C#<Q �2�+>�#�\2V �"4sC/:<!$4DCU'���(R�+4A�,� Q #�!7CU�"#�!$���;iO�"H;4�!$4RJ,4R!ICU45C"'��58-�"!$��4ACA� f #,!7:]12#�'&�$H���)%&��:<�O>�:<�;i,'):<i,4GC"')(IH�:,C ��4R>�';i,' �;:xQ 4RtdH2';�M%&!"4s% �2��>+#,\ V �$4ACP35�+i,H,�L\Y4.�;4R4s%&4A%��?d%;��(r�"��#��):�!"VK#<Qn!$#2#<�$C9Q #�!P4RJ�4A��:/354A%&��';3 C"�+wA4A%D%&��(*�$�+#,�):<!$V ~�C$: V �,W,y�y,y�y.!$# #��$CI���C�>+� ��4A>+V �"#5#&(R(r')= V�: Q 4At 354Ai,:<\2V �"4sCR�

f �+�M:<>�>+V��A�+Q2�"H;493D:<���/354R35#�!$V@: JB:<��>�:<\;>�4v��CqJ�4R!$V@C"3D:<>�>)~�C$: V �s:PQ 4Rt �2�+>�#�\2V �"4sC$� 9��\Y#<�"H��"H)4.C"'��58&4AC�:<�M%D�"H)4.%;��(r�"��#��):�!"VD#�Qq!"#2#��$CPH): J�4@�"#K\M4/CU�"#,!"4s%�#�� �"H;4/%&��C �Y�����C"')(IH :x(R:,CU4��,�+�P35��i�H ��\M40=;!$4rQ 4R!I:<\)>+4L�$#x'MCU40CU#,!U�$4A%D!$4RJ,4R!ICU4@C"'��585�$:�\;>+40#BJ�4A!�"!$��4ACA�

���)%&4R8&4ACv(R:��K:�>�C"#G\Y4�\;';��>��9Q #,!9CU#,!U�$4A% M>+4sCv#��5%&��C � �<���x=):�!U�$��(R';>�:<! � Q #�!9%&��(*�"��# ��):�!"VO#<Q[!$#2#<�$C��MC"#�!"�"4s% !"4AJ�4A!$C"47CU' �K8 �I:<\;>�4 �z%&��(*�"��#��M:<!$V�#�Q[�+�)%;4A(r>����):<\;>�47tP#�!I%;C��4r�I(<�7?@� ���)%&4R8-CU=Y4R4s%;C0';=}C"4A:�!$(IH�#�Q�C"#�!"�"4A% )>+4sCR�x?h>�CU#OCU';�+�$:�\;>�4K:�!"4K%&V2�):<35��(%;:<�$:0Cb�$!"')(r�"';!$4ACT#BJ,4R!v%&��C � ��C"')(IHK:,CvN � �"!$4R4sCR� 9´9 12���)(r4����)%&4r8&4sC9:<!$4 3 'M(IHKC"3D:<>�>+4A!�"HM:<���"H;4 )>�4ACL(R#�� �$:��+�)�+�;i5:�(r�"'):�>n%;:B�I: � �"H)4RV�(A:<�O\M4.>�#,:,%&4A%O:<�)% ��4A=&�L�+�O3D:<���354R35#�!$V��-� �KC"H;#�';>�% \Y4 354R� �$�+#,�;4A%��$H):B�K�;#<�K3 ')(IH t�#,! � H):�C \M4A4R� %;#��;4�#,�CU�"#�!$���;i �$!"��4ACh#�� %&��C �z�

f �+�M:<>�>+V��z�"H;4A!"45��C@�$H;45��C$C"';45#<Q H;#Bt #<Q �"4A�}:�!"4K�;4At =):�!$:,%&�+i,3DCG:,%;%&4A%n� |}4C"H;#�';>�%�!$4A(R:�>+>h�"H):<� =):<!I:�%;�+i,35C (R:<�l\Y4-(R#�35=;��>+4s%�#��;>�V �+Q7:<>�>h�$H;4-=):�!$:,%&��i�3DCQ #�!�:/>�:��;i�'M:<i�4L:�!"4h: JB:<��>�:<\;>�4P�"#�i,4r�$H;4R!s� ��H)��C 3K4s:<�)C9�"H):<� H): J2�+�)i7(r#�35=;��>�4A%K�"H)4=):�!$:,%&�+i,3DC �B�+Q�t�4L(r#,354h:�(r!$#,C$Cv:0�;4Rt =):<!I:�%;�+i,3{~�C$: V �<tLH)4R�K�"H;4L35#,!"=;H)#�>�#�i���(R:�>:<�M:<>�V wA4R!L��Ch����')C"4s� �)�"H;4A!"4 ��CL�)#�4A:,CUV�tP: VD�$# :�%)%O:��;4Rt =):<!I:�%;�+i,3O��� �GtP#�';>�%!$4A� ';��!"4�:�!$4A(R#�35=;��>�:<�"��#�� :��)%�!"4Ai�4A�;4R!I:B�$�+#,� #�QL�"H;4O%;:B�I:]Cb�$!"'M(*�"')!"4-~ C": V��q�$!"��4 �C"#�!"�"4A%D�$:<\)>+4 � �2\M4RQ #�!$4@�$H;4.CUV&CU�"4R3�tP#�';>�% CU�$:�!U�P!"4s(r#,i��;��wR���;i :��)%D')C"�+�)i �$H;4G�)4Rt=):�!$:,%&�+i,3 � 9 �¼�� �)×/Ç�ÈÉÈ Ç�×>Ê�Ó¢Â�ÃMÊ�Ë@×>Áp×>Ê�À�Õ6×/ÇkÕ���Á1ÇpÒ�Ç�ÄÉÈÎÇ��¢ÈÉÁ3ÁkÄ Ã!�¢ÁkÀ ��Á ½ Ç�Ó¢Ô�Á3Ã!�¢Á ½ Ê�×>Ñ¢Ó¤Ã�ÁkÀ ��Ç�ÔcÇSÔ�×/Ç�ÈÉÈÇ�×>Ê�Ó¢Â*Ã@Ê�ˤÑ���Õ)Ô�Ä ½ Ç�È�×>Ák×>Ê�À�ÕcÊ�À ��Á ½ Ç�Ó¤Ô�ÁlÇ�¤Ê�à �¢ÁkÀqÇ�ѢѢÈÉÄ ½ Ç´Ã�ÄÉÊ� ½ Ç�Â\Ô�Ñ�Ç�À�ÁqÊ�Â¢È Õ1ÇMÔ�×/Ç�ÈÉÈ�Ç�×>Ê�Ó¢Â�ÃÊ�Ël×>Ák×>Ê�À�ÕoË Ê�ÀG×>Ê�À�Ñ��¢Ê�ÈÉÊ���Ä ½ Ç�ÈEÇ�Â�Ç�È Õ)Ô�ÄÉÔpÏ �  ÁWV¤Ç�×>Ñ¢ÈÉÁTÊ�Ë«Ã!�¢Á6ÈÎÇ´Ã�Ã�ÁkÀ �NÊ�Ó¤ÈÉÍ� ÁSÇ�Â&Ákꢀ Ã�Ê�ÀGÊ�ÀÇ �NÊ�À�Í Ñ¤À�Ê ½ ÁkÔ�Ô�Ê�À�� �¢Ä ½ � ½ Ç� Ô�Ñ¢Ç�À�ÁoÊ�Â¢È Õ Ç Ô�×/Ç�ÈÉÈlÇ�×>Ê�Ó¢Â�Ã6Ê�Ë3×>Ák×>Ê�À�Õ&Ë Ê�À6×>Ê�À�Ñ��¢Ê�ÈÉÊ���Ä ½ Ç�ÈÇ�Â�Ç�È Õ��kÁpÀ�� �¢Ä ½ �`ÄÉÔcÑ¢Ç�À�ÃcÊ�Ë�ÇSÔ�Ñ�ÁkÈÉÈÉÄÉÂ�� ½ �¢Á ½ Ø�ÁkÀKϼP¼�� Å Ã�À�ÁkÁpÔ Ç�À�ÁGꢀ U ÁpÀ�ÁkÂ�ÃcË À�Ê�×�Ê�À�Í¢ÁkÀ�ÁkÍ �¢ÄÉÂ�Ç�À�Õ/Ã�À�ÁkÁkÔKϼ!� � Ê�À�×/Ç�ÈÉÈ Õ �sÇ " À�Á $ ½ Ê�×>Ñ¢ÄÉÈÎÇ´Ã�ÄÉÊ�Â&Ã�Ç�Ø�ÁpÔTÇoÈÎÇ�À ��Á>Ç�×>Ê�Ó¢Â*Ã1Ê�ËlÃ�ÄÉ×>Á " ÇoË Á%��×>ÄÉÂ�Ó¤Ã�ÁpÔ3Ã�ʱÇ/Ë Á%��¢Ê�Ó¢À�ÔMÍ¢ÁkÑ Ák¢ͤÄÉÂ�� Ê�Â/à �¢Á1ÈÎÇ�Â���Ó�Ç���Á $ � �¢Ák ½ Ê�×>Ñ¢Ç�À�ÁkÍoÃ�Ê ×>Ê�À�Ñ��¢Ê�ÈÉÊ���Ä ½ Ç�ÈWÇ�¢Ç�È Õ¤Ô�ÄÉÔ " ÇSË À Ç ½ Ã�ÄÉÊ�Â

Page 59: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� � ���� � �� �� �������� ������ ���� � ��[� � � � ��� �������������� '� � ���!� � �"�&e��H2')C��n�"H)4R!$4D��C7: �)4R4A%}Q #,! %&4AJ�4R>�#�=)�+�;i =;!$#�i,!$:�3DC@Q #,!7���)(r!$4R354R� �I:<> (R#�35=;� �>�:B�"��#��q� 12')(IH =)!"#,i�!I:<3DC (A:<� �I:���4 :<� :�%;%;���$�+#,�):<>P=):<!I:�%;�+i,3�:��)% :�� 4r8&��Cb�$�+�)i

%;:<�$: CU�"!$')(r�"';!$4 �z:<�)%]�+�)(R!"4A354R� �$:�>+>�V�(IH):<�;i,4/�"H)4K%;:<�$:�Cb�$!"')(r�"';!$47tL�+�"H;#,'&�.H): J ����;i��$#�!$4A(R#�35=;��>+474AJ�4A!"V �"H)�+�;iM�G� �.CUH)#�';>�%]\Y4K(R>�:�!"� )4s%O�"H):<�.:��]';� �2�;#BtL�]tP#�!I%\;'&�0\M4A>+#,�;i����;iD�$# :<�-4r8&��CU�"���;i�=M:<!I:�%&��i�3 %&#24ACh�)#<�G=Y#,C"4 :D3D:<ab#�!h=;!$#�\)>+4A3O�@� �(R:��-\Y4D:�%;%&4s%]�$#O�"H;4D%&��(*�$�+#,�):<!$V #<Q�!$#2#<�IC �n:��)%-:O!$4A(r#,35=;�+>�:B�$�+#,� ~ #�QPC"'��58&4ACI���C��;#<�h�;4A4A%&4s%��v����:<�2V (R:,CU4��2���h��C�H;#�=Y4A%��$H):B�L#��M(r4.4r8&H):�')Cb�$�+J,4G=M:<!I:�%&��i�3DC�:<!$4: JB:<��>�:�\;>�4 �2�"H)4R!$4/tL�+>�>qC"4R>�%&#�3�\M4 :5�)4R4A%��$#�:�%;%O�;4At =):�!$:,%&��i�3DCR� ��H)4/��C$CU')4/#<Q!$4A(r#,35=;�+>�:B�$�+#,� tP#�';>�%��"H;4A��(r4A:,CU4G�"#D\Y4/#<QT�+35=Y#�!"�$:��)(r4,�

� hoBQFE?/LMB U LMA1moHpJo[��!"4A4.%):B�$:5CU�"!$')(*�$';!$4AC�:<�)% C"#�!"�"4s% :<!$!I: V2CP:<!$4/%&4AC$(r!$��\M4s% ����:x>�:<!$i�40�2';3 \Y4R!

#<Q �"4r82�IC.�+��(r#,3K=)'&�"4A!.C$(r��4R�M(r4��K124R4xQ #�!.4r8;:�3K=)>+4��n:<�2V�#<Q��"H;4xQ #�>�>+#BtL���;i��"4R8 �IC �Sh#,!"#BtL�+�"w�:<�)%K1&:<H;�)�Y~U�A� e<�,� � gh4R���;i�#,>�%7:��)%7gL4A�+�)i�#�>�%�~U�A���,�,� �s#,!q|l��!U�$H�~U�A� e<W,�r��.�2'&�"H�~b�s� e<W,�@��C7:�� 4A�)(rV&(R>+#,=):<4s%&��(xtP#�! �Y�D12#,!U�$4A% M>+4sC �TN � �"!$4R4sC.:<�)% �+�M%&4r8&4AC:<!$4L%&4AC$(r!$��\M4s%5�+�5\Y# # �&C9#��D%;:<�$:<\M:�C"4ACA�T124A4@:0�"4R8 �$\M#2# �xC"')(IHD:�C[�@>+>�3D:<��~b�s��� e��#�! 0:B�"4.~b�s���2e<�*�q|l�+4s%&4R!$H;#�>�% ~U�A�,�,E���i�#24AC��+� �$#G4A>�:�\M#,!$:<�"4 %&4R�$:��+>&:<�M:<>�V wA�+�)iGC"4R4 �:<�M%->�:B�$4R�)(RV �"��3K4sC.Q #�!/%&��C �-:�(A(r4AC$CA� |}#�! ��#���CU��i��):<�"';!$4ACG�;#��/%;��C$(r')C$C"4A% H;4R!$4:<>�C"#KHM:�C���3K=Y#�!"�$:��)(r4.���OQ ';!U�$H;4R!hC"=Y4R4A%;�+�;iD')= :,(R(R4AC$CR�[124A4 �.�2'&�$H ~b�A�2eBW �9Q #,!h:%&4sC"(R!"��=&�"��#��O#<Q9C"�+i,�):B�$';!"4sCR�

n �>LMBqjNHp=WLc=o � � ��H;#2#,C"4 MJ�4 %&� �z4R!$4R� �x�;#,';�)Cx�+� V�#�')! 35#<�$H;4R!x�"#,�;i�';4,� NPV�(r#��MCU��%&4R!$���;i�"H)4R��!P%&� �z4R!$4R� �[Q #�!$3DC � ��%&4R� �"�+Q VK�"H;4G=):<!I:<354R�"4R!ICh~ CU')(IH�:,C[i,4R�)%&4A!��,�2';3 \Y4R!P4r�I(<�F�#�� tLH;��(IH-�$H;4KQ #�!$35C/%;4R=Y4R�)%����h#Bt \;';��>�%}:��$:<\)>+4K#<QPt�#,!$%]Q #�!$35CGQ #,!04s:�(IH #<Q�"H)4/�;#�';�MCR�o � k f #,!x#,�;4�#�QL�"H;4 �$:<\)>+4sC ��� 698&4A!$(R��C"4�W;����(R!"4s:B�"4�:�=):<!I:�%;�+i,3 �I:<\;>�4�')C"�+�)i=):�=M4A!h:<�)%O=Y4R�)(R�+> �o � o gL4A=M4s:B�@698&4A!$(R��C"40W)�+�.\;';�LQ #�! )J,40J,4R!$\)C����)Cb�$4A:,% #�Q )J,4.�;#�';�MCR�o � � Sh#Btl3D:�� V5%&� �Y4A!"4A� �[Q #�!$3DCG~ CU')(IH�:,C[i,H ')';3D:B�$:,: �,i�H2';';3D:<�M:�:,�[%&#7J�4A!"\MC���-V�#,';!@>�:<�)i�'):�i�4/�I:���4 � f #�!04A:,(IH]#<Q9�$H;4 Q #,!"3DCG��%;4R� �"�+Q V �"H;4xi�4A�)%&4R! �z=M4A!$C"#�� ��"4A�)C"4/4r�$(��o � � ��#�35354R� �7#,� �$H;4 C"';�+�$:<\)�+>����bV #<QP�"H;4�C$(IH;4A3K4�%;4AC$(r!$�+\Y4A%}�����"H;��C7(IH):�=&�"4A!Q #�!LJ,4R!$\)C�����V,#�';!L>�:<�;i,'):<i,4��[�P:<�OV�#,'�=;!$#�=Y#,C"4.:5\M4R�U�"4A!@:<>+�"4A!"�M:B�"��J�4 �o � � G#]:O(R#�35=):�!$:<�"��J�4xCU�"'M%&V]#<Q�4 ��(R�+4A�)(rV]#�QPCU�"#,!$:�i�45:<�)% =;!$#2(R4AC$CU���;i��"��354\Y4r�btP4R4R� ')C"���;iK�"!$�+4sCL:<�)%��+�M%&4r8&4A% C"4A� ';4A�,�$��:�> )>�4��o � � �9#BtP4R>@HM:<!$3K#,�2V (R:��uCU��35=;>���Q V �"H)4-tP#�!I% =M:<!I:�%&��i�3DC�:��)%�!"4s%&')(R4��"H;4A�+!�2';3 \Y4R!s� |lH):<�KtP#�';>�% �;4A4A% �"#}\M4�%&#,�;4 �9�+QGtP4 t�:<� �K�"#-���)(R#�!$=M#,!$:<�"4 J,#Bt�4A>H):�!"35#��2VD���O�"H;4/35#�!$=;H;#,>+#,i���(R:�>Y:��):<>�V2wR4R!s�Ê�ËqÇ6Ô�Á ½ Ê�Â¢Í $PÏ

Page 60: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,� ������� ��� � � ���� ������� ����� �� ������ �� � �

Page 61: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ������� � �

� � � � � � � � ����� � � �

�� �� ��������������� ��!"�#�$&%('*),+-%/.0+1%32145+-21687095+;:16 <=6�>?+-@=)?:16">?ACBD<E6"6GFIHJ<E'KH1<L'*6"<8M17N@=)?>O>P@E936"<E6Q+-<E6G43%3)O@E7�FQ93),RL9H*R"R"43<S)?%UT3V*68'UH1<L'*6"<8WYXG936�Z/HJ7N@S)?Z/[5HJ<N@L+-%\@S6"V*+1Z/[3>O687]H1B�@=93687N6�+-<E6^@=9(6KZ_+-)?%:16�<=`�BDH1>?>?HaFI68'b`PA�+14*V*)O>?),+-<EA�:16�<=`�7N68c\436"%(R"6�7]+1%('d%3H14(%(7GBDH1>?>?HaFI68'b`PAb[eHJ7N@=[eHJ7=)Of@=)?H1%57"W�gh6i@=6"<EZj7=4(RL9d43%3)O@E7]+J7I:J6"<E`b2J<=HJ43[(7G+-%('�%3HJ43%�2J<=HJ43[(7 <E6�7=[568Rk@=)?:16�>OAJW�$l@Z_+;A�`e6i%(H-@=68'�@=9(+-@G:J6"<E`�2J<=HJ43[(7G+-%5'b%3HJ43%d21<EH143[(7 FQ)?>O>0`56^7=43`*fl[(+-<=@E7 H1BmFQ9(+-@+-<E6 %3H1<EZ_+->?>OAKR�+->?>O68'K:J6"<E`K[39(<E+J7N687�+-%('#%3H14(%#[39(<E+J7N687"na<E6�7=[568Rk@E)O:J6">?A1n-)?%_op%32J>O),7N90Wq]HaF 6":J6"<8n�)?%hHJ43<BDHJ<=Z#43>?+-@=)?H1%hFI6�'3H�%3H-@^457N6/@E936bRrHJ%(Rr6�[*@E7^H-BG%3H143%s[39(<E+J7N687+-%5'b:J6"<E`�[39(<E+J7N687tBDHJ<Q@=9(6CBDH1>?>OHaFQ)?%32�<=68+17=H1%(7�uv W]XG936�RrHJ%(Rr6�[*@�H-B:16�<=`w[393<L+17=6�'*HP6�7�%3H-@b7=6"6�Zx%(+-@=43<L+->GBDHJ<�$&%('*),+-%y>,+-%3f214(+1216�7�Wz W]{3<EH1Z|RrHJZ/[34*@E+-@=)?H1%(+1>�[5HJ)O%\@H-Bt:P)?6"Fn�<E6�R"H12J%3)}@E)OHJ%�H-B %3H14(%~[39(<E+J7N687S+1%(':16"<E`b[(93<E+J7N687G)?7G%(6")O@=936�<Y7N)?Z/[3>?6i%(H1<Q6r��R")O6�%J@8W� %�@=9(6KH-@E936"<Y9(+-%('�n5%3HJ43%�2J<=HJ43[(7]+1%('�:16�<=`�21<EH14([(7]R"+1%�`e6BDH1<EZ/6�'�4(7=)O%(2H1%(>OA#>OH*R"+1>m��+->,7NH^R�+->?>O68'�7=43<=B�+1R"68��)?%*BDH1<EZ_+a@E)OHJ%/+1%('/Z/H1<E6Q)OZ/[eH1<=@E+1%J@E>OAK@=936�A#[(<=H1f:P)?'36Y7N43�_R")O6�%\@t)O%3BDH1<EZ/+-@=)?H1%e�tBDHJ<�BD43<=@=936�<t[3<EH*Rr687=7=)O%(2iH1B�@=936Y7=6"%\@E6"%(R"6Y+1R�RrH1<L'*)?%32@=H���+1%3)?%3)?+1%��a+1<E+1�;+�@=9(6"H1<EA1W��PHh@=936�>?H*R"+1>QFIHJ<E'�21<EH143[()O%32h[3<EHa:P)?'*687_+->?>Q@=9(6%368Rr6�7E7E+-<EA_)O%*BDHJ<=Z_+-@=)?H1%dFQ)}@E9dZ/)?%3)?ZK43Z�RrH1Z/[343@E+a@E)OHJ%(+->�6"�eHJ<N@8W� %(H-@=9(6"<)?Z�[eH1<=@E+1%\@C[eH1)?%\@K+-`eH14*@^HJ43<>?HPR�+->�:J6"<E`�21<EH14([3)O%(2d),7i@=95+a@^F 6/'3H%3H1@Y+a@N@E6"Z/[*@]@EH�'*),7�@E)O%32J43),7N9U+->?>�@E936CT(%36^7=9(+1'36�7QH1B�7=6"Z_+-%\@E)?R�7Q+17E7NH*Rr),+a@E6�'�FQ)}@E9@=9(6�7=6_:16"<E`~7=6�c\436�%(Rr687"W � 43<6"V*[56�<=)?6"%(R"6/FQ)}@E9s'(+a@E+�BD<EH1Z|:a+1<=)?H14(7i$&%('3)?+1%h>,+-%3f2145+-21687^7=43212J6�7N@E7@E9(+a@#@=Hh+U>?+1<=2J6�6rVP@E6"%\@K@E936�7=6�T(%(6�7=9(+1'*687K+1<=6bR"H1%P:16�A168'~`PA���0�8� Ô ���8�?�k� ×]�E� ���k�Q���k� Ô � Ô���Ô �L�e� Ñ � �kÕ �k  �8¡;� � Í � Ò ��¢;� �L£r� � � � � � Ô �O�k� ×]�E� ���k�]� Ó;¤�¥kÔ=¡"� � ¢ ¥3Í � Ô�¦� Ó¢Ô�Ô�¥kÍ ���§�� ��ÑsÏe¨¤Ï

©Jª

Page 62: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� ���������� ������������������ ���� ��"!#��$&%'�

),'*6"%\@=),R"+1>tRrHJ%P:16"%\@E)OHJ%(7C+-Z/H1%32�$&%('3)?+1%h>,+-%(214(+1216�7C+1%('~7=HdBDH1<@E<E+1%(7=>?+-@=)?H1%h[343<=f[eHJ7=6QFI6Q%36�6�'�%3H1@t'*)?7E+-Z#`3)?214(+-@=6 @=936�Z�W�XG9()?7p+1[3[3<EHJ+JRL9#),7p+->,7=HCR"H1%(7=),7�@E6"%\@pFQ)}@E9$&%('*),+-%s2J<E+1Z�Z_+-@=),R"+->�+1%(+->?A*7N),7CFQ936"<E6_Z/6�+1%3)O%(2d),76"V\@E<E+JRk@E6�'~)O%�7=6":J6"<L+->�>?+;AJ6"<L7FQ)O@=9�)O%5Rr<E6�+17=)?%32#[(<=68Rr),7N)?H1%�WXG936_@E93)?<E's)?Z/[5HJ<N@L+-%\@K[eH1)?%J@#)?7#+-`eH14*@KHJ43<#7N@=<L+a@E6"2JA�BDH1<K21<L+-Z/Z_+-<^'*687N)?21%�W� 7p%3H-@E6�'/`PA#��+-@E+-%�(N+->?)3+-%PA^[3<L+1Rr@=),R"+->3+1%('/RrHJZ�[(<=6�936"%(7=)?:16G21<L+-Z/Z_+-<p7=93H14(>?'�`e6FQ<E)}@=@=6"%#)O%*) 43@E7E+-<E2J+]+1[(+;:a+1+1'(+,+�+1[3[3<EHJ+JRL9�W�$&%^@E93)?7�+1[3[3<EHJ+1RL9<E43>?6�7�+-<E6t+1<=<L+-%32J6�')?%�7=6":J6"<L+->�>,+;A16"<L7I6�+1RL9�BDH1<EZ/)O%(2/+1%�6"V3Rr6"[3@=)?H1%d@=H�@=9(6[3<=6�:P)OHJ4(7G>?+;AJ6"<8W�� .- /10Y�3254 ���#�7698� 7 '*687=R"<=)?`568')?%^@=9(6t>,+17N@ 7=6�Rk@E)OHJ%�n;@=9(6"<E6I+-<E6�@�AP[3),R"+1>O>?Ai@�FIH]�P)?%('37mH-B3F H1<L'C21<EH143[57RrHJ%(7=)?7N@=)?%32�H1B]%3H143%57#+1%(' [(+1<E7E+-<E2J7���H1<#[5H\7�@E[5H\7N)O@=)?H1%(7L�knp+1%(' Z_+-)?%�:J6"<E`(7K+1%('+-43VP)?>?)?+1<=A#:16"<E`(7�n1<E6�7=[568Rk@E)O:J6">?A1W�XG936Y6"V*+JRk@t2J<=HJ43[(7�BDHJ<=Z/68'�nJ:a+1<=A#BD<=HJZ >,+-%(214(+1216@=Hi>,+-%32J4(+-2J61W0{(H1< 6rV3+-Z/[3>?61na)?%�qY)O%5'*)�nJ7N68cJ4(6"%(R"6tH-B5:16"<E`(7�naZ_+-)?%#+-%5'K+-43VP)?>?)?+1<=)?6�7�nH*R"R"43<�+J7#7=6"[5+-<L+a@=6bFIHJ<E'37#+-%('�936"%(R"6b9(+;:J6�@EH�`e6�2J<=HJ43[568's@=HJ216"@=936�<�W~$&%�@=9(67=H14*@E9�$&%('*),+-%�>?+1%3214(+121687Q@=9(6"AUH*R"R"43<Y@EH12J6r@=9(6"<8n�R"H1%:(�HJ)O%(6�'U)?%\@=H�+b7=)O%32J>O6#FIHJ<E'�M+17 +^<E6�7=43>O@�n\@=9(6i+1%(+->?A*7N),7p),7 >O6"B @I@EH#Z/H1<E[393HJ>OHJ21A#<E+-@=936�<t@E9(+-%b@=H^@E936i>OH*R"+1>5F H1<L'21<EH14([56�<�W;�<>= <@? ACBED&F�GIHKJ�L�G�MONGPB,Q�RXG936C�P<=)?AJ+#<E43[(+/RL9(+-<=@E7G7=[568Rr)OBDA�@E936C21<EH143[(7I@EH_`56iBDH1<EZ/6�'�H14*@]H1B0@E936^7N68c\436"%(R"6H-B�:J6"<E`(7pFQ9()?RL9b'36"%3H1@=6S+K7N)?%321>?6S+JRk@E)OHJ%�W X +-�J6QBDH1< 6rV3+1Z�[(>O6�) �P9(+1+^<E+19(+1+9(6")S+J)?%q])?%('*)eFQ93),RL9bRrHJ%(7=)?7N@E7tH-B�@=93<E6"6Y:16"<E`(7t)O%b+K7N68cJ4(6"%(R"61n\`34*@t@E936"A#@=HJ216"@=936�<I'*6�%3H-@E6+_7=)O%32J>O6+JRk@]H-B�6�+-@=)?%32(WIXG936<=HJ>O6CH1Bm@E936^+-4*V*)?>O),+-<EA�:J6"<E`�),7G@=H_2J)O:J6C)O%*BDHJ<=Z_+-@=)?H1%+-`eH143@Q@=6"%57N6Jn3+17=[568Rk@�n(Z�H*'3+1>O)O@�A�6"@ER-WXmH^6"%(+1`3>?6Q@=936YZ/+JRL93)?%36Q@=H�'*H@E936T(�H1`bH-B�21<EH143[()O%325n-@E936]BDHJ>O>?HaFQ)O%(2)O%*BDHJ<=Z_+-f@=)?H1%�FQ)?>O>�`e6<E6�c\43)?<=68'v WQ[5H\7=7=)O`(>O6C:16�<=`5+->�<=HPH1@E7G)?%�7=6�c\436�%(Rr687z WQ)O%*BDHJ<=Z_+-@=)?H1%�+1`5HJ4*@]21%([d+121<E6"6"Z/6�%J@UQ43>?6�7bH-B216�%('*6�<�nG%P43ZK`e6"<8nQ[e6"<L7NHJ% ��21%3[e�_+-2J<=6�6"Z/6"%\@b+-<E6�RrHJZ/[(+-<L+a@E)O:J6">?ARrHJZ/[3>O),R"+-@=68'�)?%�q])?%('*) WpXG936C%3HJ<=Z_+->�R"+J7N6SFIHJ43>,'�`e6C+#:16�<=`�BDH1<EZ >O)?�16V) �P9(+J+a@L+1+<L+-9\@E+J+/936")S+OneFQ936�<=6@E936K2J6"%('36"<Y+1%('U%P43ZK`e6"<SH-B�6�+JRL9U:16�<=`�R"H1)?%(Rr),'*6�7YFQ)}@E9U@=9(621%([�H1Bm@E936FQ93H1>?67N68c\436"%(R"61W3W 4*@]RrHJ%(7=)?'*6�<G@=936CBDHJ>O>?HaFQ)?%32/:16"<E`�7=6�c\436�%(Rr687v WQ�\95+1+a@E)O)�<L+-95+a@=)?)�936")YXz WQ[(+[ZS9(+a@E6C<E+19(+-%(+J+K9(6")$&%y� v �knm@=936�[(>O43<L+->?)O@�A�H-B @=9(6�FQ93H1>?6�7=6�c\436"%5Rr6_),7<=6]\(6�Rr@=68'~HJ%3>?A�)?%~@E9(+a@#H-B@=9(6#>,+17N@S:J6"<E`�FQ936"<E6�+J7Y)?% � z �]@=936�[3>?43<E+1>O)O@�A�)?7i)?%('*6�[56�%('*6"%\@CH-Bp@E936�)O%('3)O:P),'*4(+->F H1<L'37C��{ )O2J43<E6i©5W v �kW

Page 63: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� �,���P� ��I� ��"!#��� �3v��� �����������������������������! �"����$#&%('*)+��,)+-.)/��� �,01-,���2"23 45-,���6�70�098;:=< �,��

�+�,��>#?%('*-,���2"*�,�(%,�A@B7CEDGF,H*F,I,F7F J�F�H*K�FAL�F7F M�F�K�F�L�F,F K�NPOQC L�F7F M�F,K F L�F,F K NPO

RQS�T U�V RQS�T U�V R�W>T U�V RQS�T U�VX;CEDGF,H*F,I;OZY;F7F7[ J�F�H*K�FAL\OGO M�F�K�F�L\O]O K�NPO^[_C`L�F7F M�F,K F L�F,F K NPO

R+a$T U�V R+a�T U�V R�W>T J V R+a$T J Vb!CEDGF,H*F,I;OZY;F7F7[ J�F�H*K�FAL\OGO M�F�K�F�L\O]O^[ K�NPO^[_CcOGd�ePf,M6M\N2e2L U NPd�L\NPd ePN

R+a$T U�V R+a�T J V R�W>T J Vg CEDGF,H*F,I>NhI>f J�F�H*K�FAL\N M�F�K�F,d F7F K�NPOQC L�F7F M�F,K F d F7F K N2O

RQS�T U�V RQS�T U�V R�W>T U�V R�W�T W,Vi;CEDGF,H*F,I>NhI>f J�F�H*K�FAL�F7F M�F�K�F,d F7F K�NPOQC OGd�ePf,M6M\N2e2L U NPd�L\NPd ePN

RQS�T U�V RQS�T U�V R�W>T U�V

j �/�����>kSmlnS F U e2o D]O]d N T!a/l=a N S O]d O]d N T�U�l�U O]d p,o DGF�M T J l J D]o!M�F,Dq lsr f7dut Lve.FAM\N R d f�ePf,d U L6M�F�OGd�Lvf7dxw7F�D]o N V

{ )O2J43<=6C©5W v u�X +-`(>O6CH-B�7NHJZ/6:16"<E`�7=6�c\436�%(Rr687

XG936i>O)?%32J43)?7N@GFQ)O>?>�9(+;:16Y@=H�[3<EHa:\),'*6S@=93),7 )O%3BDH1<EZ/+-@=)?H1%�W�XG936iT(<L7N@I@L+17=�/@=936�<=6"fBDH1<E6_),7C@=H�'*687=R"<=)?`e6#@E936b+1`5Ha:J6�)?%*BDHJ<=Z_+a@E)OHJ%~)?%�7=H1Z/6�T3V*6�'~BDH1<EZ_+a@�W�Xm+1�16/@=9(6@=9(<=6�6i:J6"<E`*f BDH1<EZ/7 )?%Uq])?%('*) nv WQ�\95+1+a@L+1+#<E+19(+a@L+1+K936")z WQ�\95+1+a@E)O)�<L+-95+a@=)?)�936")YXy WQ�\95+1+a@E6S<L+-95+-%(+J+K936�)XG936C>?)O%32J43),7�@E)?RC)?%*BDH1<EZ_+a@E)OHJ%bBDHJ<^� v �G+1%('h� z � FQ)?>?>�`566"V*[3<=687=7=6�'�+17 BDHJ>O>?HaF]7"u

z>{A|;}�z ~��;{>{>�,��{��!{>�,��{>{>���;}���>���,�7�>� ~�� �>�����!������P�� },� � { � �>}>} ���A� };��~��;{>{��${ � � � { � � �6�,� �;{��;{,�;{>{���{ � � � { � � �6�,�

�;};��� �u� { � � � { � � �� ��{,�;� � ~?��{,�>�;{��{��;{A��{��>��{ ����� ���A��{,�!�,� � �7�!z7}�~ � �,�A��{>zXG936p>,+-`e6">1T(6">,'+-`eHa:16�)?%('*),R"+-@=687�@=9(6p<E+;FsX � X >,+-`e6">e��X � X 7N@E+1%('37�BDHJ<�@=6�%(7=6+17=[e6�Rk@Z/H*'3+->?)O@�A*�]BDH1<i@E936��D6�%J@E)O<E68�Y:16�<=`~21<EH143[0WK$l@^RrHJ%(7N),7N@E7iH-BIR"H1%(R�+a@E6"%(+-@=)?H1%H-BQ@E936�@E+-Z H1BQ@=936dZ_+-)?%�:16�<=`�n BDHJ>O>?HaFI68's`PA~@E936d<=HPH-@L7K+1%(' <L+;F @L+-Z_7#H-BQ@=9(6<E6"Z_+-)?%3)?%32~:J6"<E`(7�np7N6�[(+-<L+a@E6�' `PAK) +OW $&% @E936UR"+17=6bH1BiqY)O%('3)�nt@=936�<L+;F @E+1Z H-B+d:16�<=`~)?7^7=)?Z�[(>OAU@E936_6"%5'*)O%(2dH1Bt@E936_:16�<=`�W/XG936/>,+-`e6">p),7C43%3),c\436�BDH1<C@=9(6_:16"<E`7=6�c\436"%5Rr6/�D<EH\H1@ H1B�@=9(6iZ_+1)O%�:16"<E`�%3H1@Q)O%(R">O45'*6�'(�rn3+-%('�R"+1%b`e6i457N68'_BDH1<G2J6r@N@E)O%(2@=9(6�+-`eHa:16_7N[e6�R")}TeR"+a@E)OHJ%sH14*@^H1BG+1>O>p7=4(RL9 7N[e6�R")}TeR"+a@E)OHJ%(7C@E9(+a@^Z/)?219\@^`56/@E936"<E61W�P68c1f&+-2J<=6�6rf&7N[e6�R ),7t+^7=[e6�Rr)OT5R�+a@=)?H1%_2J)O:P)?%32C@=9(6S7=6�c\436"%5Rr6]H1B�:J6"<E`_<=HPH1@E7p+1%('�@=936�)O<

Page 64: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�1z ���������� ������������������ ���� ��"!#��$&%'�

@E+1Z_7"n(+1%('b@=936<E43>?6�7GH-B�+-2J<=6�6"Z/6"%\@8W��S2-fl21%3[d21)?:1687I@=936K7=[e6�Rr)OT5R�+a@=)?H1%�BDH1<GT5>O>?)O%(2216�%('*6�<�ne%P43ZK`e6"<8n�+-%('U[e6"<L7=H1%�H1B�@=936�:16�<=`�2J<=HJ43[�Wi�p<L+;A1H12/)?%('*),R"+-@=6�7Y@=9(6#�P)?%('H-B�7=6"%\@=6�%(Rr6C)?%dFQ9()?RL9�@=93),7]7=6�c\436�%(Rr6R"+1%�H*R�Rr43<8W$&%�@=936�6rV3+1Z�[(>O6U+-`eHa:16Jnp@E936U7=c\4(+1<=6d`3<L+1RL�16"@E7#21)?:16d@=9(6�7=[e6�Rr)OT5R�+a@=)?H1%57/<=6"f2J+1<E'3)O%32U2J6"%('36"<8nm%P43Z#`56�<�n�+-%('s[e6"<L7=H1%�n <=687N[e6�Rr@=)?:16�>OAJW��S2-fl21%3[ )?%('*),R"+-@=687^93HaF@=9(6]21%3[_H1B�@=936]:J6"<E`/21<EH143[/),7�@=HK`56Y+1<=<E)?:16�'�+a@tBD<=HJZ @E936]21%([_H-B�)}@L7tR"H1%(7N@=)O@=436�%\@:16�<=`57"W { )?<E7N@�%P43ZK`e6"<�)?%y7=c\4(+1<=6d`3<L+1RL�J6r@E7�npf z )?%('*),R"+a@E6�7�@E9(+a@b2J6"%('36"<_H-Bi@=9(6:16�<=`b21<EH143[�),7t@=H�`56iH1`*@L+-)?%36�'�BD<=HJZ�@=936i216�%('*6�<IH1B�@=936C7=6�RrHJ%('_>,+17N@ :J6"<E`�)?%�@=9(67=6�c\436"%5Rr61n�+-%5'�@=936#BDH1>?>?HaFQ)O%32�f v + 7Y)O%('3)?R�+a@=6K@=9(+-@i%P43Z#`56�<i+1%('U[e6"<L7NHJ%�ne<=687N[e6�Rrf@=)?:16�>OAJn(H1Bm@E936K:J6"<E`�2J<=HJ43[d@E+-�J6C@=936�)O<S:a+->?436�7GBD<EH1Zj@=936K>?+J7�@Y:J6"<E`h��)�W 61W?n5f v FQ936�%RrHJ43%\@=68'K`(+JRL�PF +1<E'37L�kWm7N68c1f&+-2J<=6�6rf&7N[e6�RI7N9(HaF]70@E9(+a@p)OBe@=936 T(<L7�@Y��Z_+-)?%5� :16�<=`#6"%('37)?%#@L+1+(n1+-%('�),7 BDH1>?>OHaF 6�'#`PA ) <E+19(+a@L+1+E+;+1%('*) 936�)>+?n-@E936]7=6�c\436"%5Rr6Q),7�[5H\7=7=)O`(>OA#21<L+-Z�fZ_+a@E)?R�+-> W^� � Rr@=4(+1>O>?Ad@=93),7])?%*BDHJ<=Z_+a@E)OHJ%U9(+17S+->?<=68+1'*A�`56�6"%�457N68'�)O%�R"H1%(7N@=<E4(Rr@=)?%32@=9(6>?+1`56�>0+-%('�<E6r@=<E)?6":P)O%(2K@E936^7N[e6�R")}TeR"+a@E)OHJ%�W��$&%s@=9(6b7=c\4(+1<=6_`(<E+JRL�16r@L7+aB @E6"<^@L+1+ �D@E+-Z H-BG@E936�Z_+-)?% :16�<=`5�rn0@E936�T5<E7N@K+-2J<)?%('*),R"+a@E6�7I@=95+a@G@=936C2J6"%('*6�<GH-B�@E936CZ/+1)O%d:16�<=`�7N93HJ43>,'�+121<E6"6]FQ)O@=9d@=9(6S2J6"%('*6�<GH-B@=9(6i:J6"<E`�21<EH14([�n\@=9367=6�RrHJ%('b+121< )O%5'*)?R�+a@E6�7I@=9(+-@G@=936C%P43ZK`e6"<GH1B0@=9(6SZ_+-)?%d:16"<E`7=93H143>,'�+-21<E6"6 FQ)O@=9#@=936Q%P43Z#`56�<�H-B(@E936G:16�<=`�21<EH143[0n-+-%('*) f +a)?%('*),R"+a@E6�7�'*HJ% + @�R�+-<E6BDH1<Q[e6"<L7=H1%dH-B @=936:J6"<E`�W�]HJ<=Z_+1>O>?A1n;@E936Q+-21<E6"6�Z/6"%\@ <E43>?6�7�'*687=R"<=)?`568'#+1`5Ha:J6I+1<=6IBDH1>?>OHaF 6�'�WmXG936�<=6G),7 +1%6rV3R"6"[*@E)OHJ%U)O%�qY)O%5'*)�n�93HaF 6":J6"<8WIgy9(6"%36�:16"<Y@=936#:16�<=`U2J<=HJ43[�)?7]BD6"Z/)O%()O%36�[3>?43<L+-> n@=9(6#7=[568Rr)OT(6�'U+121<E6"6"Z/6�%J@]<E43>?6�7S+-<E6%3H-@Y457N68'�WQ$&%(7N@=6�+J'�n3@E936K>,+17N@Y:J6"<E`dZ#4(7N@S`e6[3>?43<L+->I+1%(' +->?>t6�>?7=6b7=)O%(2143>,+-<8WdXG9(6b216�%('*6�<K+-%('s[e6"<L7=H1% H-BG@E936b:J6"<E`h2J<=HJ43[s)?77N@=)?>O>�HJ`*@E+1)O%(6�'�4(7N)?%32/:P2-fl21%3[0WXG936^+1`5Ha:J6C7=432J216�7N@E7Q@=936Z/6r@E93H*'UH1<G@E936K+1>O2JH1<E)}@E93Z @EH_`56BDHJ>O>?HaF 6�'�`\A�@=9(6>?HPR�+->\FIHJ<E'^21<EH143[e6"<8W��i)?:16"%�+Y7=6�c\436�%(Rr6IH-B(:J6"<E`(7"n�� � @EH���n;@E936 >?+1`56�>\),70BDH1<EZ�68'`PA_@E+1�P)O%32�@E936C@E+1Z H-B�� � +1%('dRrH1%5R"+a@E6"%(+-@=)?%32/FQ)}@E9b@E936<EH\H1@E7Q+1%('�@L+-Z_7GH-B @=9(6:16�<=`57��� �@=H�� W��S7N)?%32G@=9(6t>,+-`e6"> n"@E936I7=[568Rr)OT5R"+-@=)?H1%C),7�H1`3@E+-)?%368'�W��S2-fl21%3[C),7�%3HaF4(7=6�'b@=H/H1`3@E+-)?%�@=936C21%([�H1B0@=9(6i:J6"<E`�2J<=HJ43[�W $lB�+1%b6"V*R"6"[*@E)OHJ%dR"H1%('3)}@E)OHJ%�H*R"R"43<L7�D6JW 25WOntBD6"Z/)?%3)O%(6U[3>O4(<E+1> )?% q])?%('*) �knI@=936U+-2J<=6�6"Z/6"%\@/<=4(>O687�+J7=7=H*Rr),+a@E6�' FQ)O@=9w@=9(66rV3R"6"[*@E)OHJ%b+-<E6Q@=687�@E6�'�W � @E936"<EFQ)?7=61nJ@=9(6S+-2J<=6�6"Z/6"%\@p<E43>?6�7IFQ)}@E9_@=936i7N[e6�R")}TeR"+a@E)OHJ%��+J7=7=H*Rr),+a@E6�'�FQ)O@=9U@E936K>,+-`e6"> �]+1<=6K+1[3[3>?)O68'�W]$&%�R�+17=6^H-Bt7=4(R�Rr6�7E7�n3@=9(6K:16�<=`U2J<=HJ43[),7tBDHJ<=Z/68'b+-%5'�[3<EH*Rr6�7E7=)O%32�RrHJ%J@E)O%P43687I+-@I@E936CFIHJ<E'b+aB @=6�<�� W�$&%dR"+J7N6SH-B�B�+1)O>?43<E6H-BY+121<E6"6�Z�6�%\@K<=4(>O687"n�@E936�+1`5Ha:J6�[3<EHPR"6�7E7^),7K<E6"[e6�+-@=68' FQ)}@E9�� � @EH�� . � WhXG9(6[3<EH*Rr6�7E7 H-BmBDH1<EZ�)?%32_+�:16�<=`�21<EH143[d7�@L+-<=@=)?%32KBD<EH1Z�� � @E6"<EZ�)?%(+-@=6�7GFQ9(6"%d6")O@=936�<]+:16�<=`b21<EH143[�),7IBDH1<EZ/6�'_4(7=)?%32#Z/HJ<=6Y@=9(+1%bH1%(6S:J6"<E`�`5687N),'*687�� � n*HJ< +K:16�<=`�2J<=HJ43[RrHJ%(7=)?7N@=)?%32dH-B 7=)?%321>?6#:J6"<E`�� � )?7iBDHJ<=Z/68'�WK$&%~@=936/>,+a@=@=6"<^R�+17=61n�2J%3[~H1Bt@E936/:16"<E`21<EH14([�),7t@=936i7=+1Z�6S+17�@E9(+a@ H-B�� � WQ� XUHJ<=6S7N[e6�R")?+1>O)��"68'_Z/6r@=9(HP'(7tR"+1%�`e6Y4(7=6�'�@EH+;:1HJ)?'SBDHJ<=Z/)?%32Y>,+-`e6">,70+1%('^RL9368RL�\)?%32GBDHJ<0@E93HJ7=6t7=6�c\436"%5Rr6�70FQ93),RL9KR"+1%3%3H-@m[5H\7=7=)O`(>OAH*R"R"43<�WQ�P4(RL9UZ/6"@=93H*'37S+-<E6i`e6")?%32�457N68'dBDH1<YqY)O%('3)�W]{(H1<]6"V*+1Z/[3>O6Jn3)?%J@E6"<EZ/6�'*),+a@E6:16�<=`�21<EH143[57IR"H1%\@E+1)O%b+-@QZ�H\7�@ @�F H#:J6"<E`(7"MP7=H#F 6Y@E6�7N@GBDH1< @=936�Zj'*)?<=68Rk@E>OAJW�XG9(6�7=6R"+1%y+-2J+1)O%w`e6�216�%36"<L+->?)���6�'w+aB @E6"<bZ/HJ<=6U'3+-@E+s),7b+;:a+-)?>?+1`3>?6�BD<EH1ZxH-@E936"<�$&%5'*)?+1%>,+-%32J4(+-2J6�7�W �

Page 65: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

������� %V�"!P%�� �"!P�=� �!y

�� �� � ���U�54 ���#�7698�]HJ43%�2J<=HJ43[(7]+1<=6BDHJ<=Z/68'UH14*@SH-Bp%3HJ43%(7i+-%('�[(+1<E7E+-<E2J7�WG$&%�q])?%('*) n�6�+JRL9UH-B�@=9(6[(+1<E7E+-<E2J7m216"@E7�2J<=HJ43[568'KFQ)O@=9/@E936][3<E6�R"6�'*)?%32C%3HJ43%(7�W {(H1<p6"V*+1Z/[3>O6Jna@=9(6][(+-<L7E+-<E2J7)?%�68+1RL9 H1B]@=9(6d>?)?%36�7/`e6">?HaFnp216"@_21<EH143[e6�' FQ)}@E9 @E936�[3<=68Rr68'*)O%(2~%3HJ43% >,+[Zi+-�J6�D`eHaA3�kW

z>{��!{.�!} � }z>{��!{.�!} �!}�z>����}z>{��!{.�!} � �>�

{3HJ<p@E936Y%3HJ43%_@EHK[(+1<N@E)?R")O[(+-@=6S)O%_@E936Y2J<=HJ43[3)?%32(nJ)}@GZK457�@ `56S)O%�H1`3>?)?c\436]BDH1<EZdW{3HJ<Q6rV3+-Z/[3>?61n(>?+ ZS+1�16C9(+17Q@�FIH/[eHJ7E7N)?`3>?6>O6"VP),R"+1>�6"%\@E<=)?6�7�n*H1%36^R"H1<E<=687N[eH1%5'*)O%(2K@EH7=)O%32J43>,+-<=f HJ`3>O),c\436]+-%5'�@=936SH-@=9(6"<p@EHK[3>?43<L+->Ofl'3)O<E6�Rr@�WI��XG936YHJ`3>?)?c\436iR"+17=6GBDH1< q])?%('*))?Z�[(>O)?6�7 @E9(+a@Q%3HJ43%b@L+-�J6�7 +#[5+-<L7=+1<=25W � � %(>OA_@E9367N)?%32J43>?+1<NflH1`(>O),c\436Y>?6rV*),R"+->�6�%J@E<=A@E+1�1687I[5+-<=@G)?%d21<EH143[3)?%32�FQ)}@E9d@=936C[(+1<E7E+-<E2(W XG936%P43ZK`e6"<GH-B @=9(6i%(H143%d21<EH143[�)?77=6r@Q@=H_7=)O%(2143>,+-<8WXG936^+JRk@=45+->�[(+1<E7E+-<E2#6�%(RrHJ43%\@=6�<=68'~��[5H\7=7=)O`(>OA�6"Z/[*@�A3�G),7]7�@EH1<E6�'�)O%�@E936%3HJ43%21<EH14([�+17S:\)?`39(+1�\@=) Wi$&%~Z/H1<E[393H1>?H12J)?R�+->?>OA�<=),RL9�>,+-%32J4(+-2J6�7�n3@E936#%(H143%~)}@L7N6�>}Bt2J6r@L7'*68Rr>?)O%368'�'*6�[56�%('*)?%32#HJ%_)}@L7 <=6�>?+-@=)?H1%(7=93)?[_FQ)}@E9_@=936i:16�<=`0Wm$&%�>,+-%(214(+1216�7p>O687=7I<=),RL9)?%�Z/HJ<=[39(H1>?H121AJn8@=936Q[(+1<E7E+-<E2S7=6"<E:1687�+i7=)?Z�)?>,+-<�[343<E[5H\7N6JWPW A^)?%(R"H1<E[5HJ<E+-@=)?%32S`eH-@E9@=9(6�7=6K)?%�@=936#21<EH143[�+1%('UR"+1>O>?)O%(2�)}@i:P)O`395+-�\@=) n(F 6#+1<=6^+1`3>O6^@=H�'36�+->mFQ)}@E9�)O@S)?%�+43%3)OBDH1<EZjFG+;A�'*43<E)?%32_RrH1<E6C[(+-<L7=)O%325W$&%�@=936^7=6"%\@=6�%(Rr6Jnz>{��!{.�!} � �!{>z7{ ���!{7{ �;{��;} �;};���|!�,� � � �7���A� � }�{,� � � ��� {,��}� � �,� � {,��}�}>{,�!� ��� � �7����� � ��

@=9(6T(<L7�@Y%(H143%U2J<=HJ43[�),7QBDHJ<=Z/68'�HJ4*@YH1B�>,+[Zi+-�J6^+->?H1%36JW � %3>?A�@=936^[(>O43<L+->Of&'*)O<E6�Rr@>?6rV*)?R�+->�6�%J@E<=A�@E+-�J6�7G[(+1<N@8n3+-%('b@=9(6%\4(ZK`e6"<]H1Bm<E6�7=43>}@E)O%(2�%(H143%�21<EH14([b),7Q[3>?43<E+1>�W�� N� �_�����i�P0������-�#� 4 ������������ 0��V0 �"�V6!� 0S���gy93)?>O6�@=936b+1[3[3<EHJ+JRL9~HJ4*@=>?)O%(6�' +-`eHa:16_F H1<E�*7c\43)}@E6�F 6">?>�BDH1<^Z/H\7�@KH1BI@E936�7=6"%3f@=6�%(Rr687"nG@E936"<E6�+-<E6�7=H1Z/6U[3<EH1`3>?6"Z R"+J7N687"W�XG936�[3<EH1`3>?6"Z_7_457N4(+1>O>?A�+1<=),7=6�7�'*4(6@=H�+-ZK`()O2J43)}@�A�)O%U>?6rV*),R"+1>0R"+-@=6"2JH1<EA�H-B�F H1<L'37�n*FQ93)?RL9U[(<=H*'*4(R"6�7]R"H1%�\5)?Rr@Y)O%UF H1<L'21<EH14([3)O%(2(W#ZS6"[e6"%5'*)O%(2^H1%/FQ9(+-@p>O6"VP),R"+1>(R"+-@=6�21H1<EA),7t+1Rr@=4(+1>O>?A^[3<E6�7=6"%\@8n1)O@t<=687N4(>}@L7)?%�+/'*)O��6"<E6"%\@]FIHJ<E'b21<EH143[0WXmH]9(+-%5'*>O6t@=936I[3<EH1`3>?6"Z R"+J7N687�F 6p%36"68'^+�\(6"V*)O`3>?6I+1[3[3<EHJ+JRL9iFQ9()?RL9KR�+-%Z_+-�J64(7=6KH1BI7N[e6�R")?+1>m<E43>?6�7i+-%('�[5H\7=7=)O`(>OAJn�R�+17=6^`PA�R"+J7N6K+1%(+->?A*7N),7�WYgh6KBDHJ>O>?HaF @=936/+-[3f[3<EHJ+JRL9^)O%/FQ93),RL9K2J<E+1Z/Z/+1<m<E43>?6�7�+1<=6G+-<E<E+1%32168'C)O%/>,+;A16�<E7�n;6�+1RL9#>?+;AJ6"<�RrHJ%J@L+-)?%3)?%32<E43>O687S+1%('�BDHJ<=Z/)?%32�+1%�6rV3Rr6�[*@=)?H1%�@=H�@E936�93)O2J936"<S>?+;AJ6"<8WSXG93),7i+-[3[3<EHJ+JRL9�n5R�+->?>O68'4*@L7=+1<=2\+af&+-[(+;:a+1+J'3+K��'*6rB�+143>O@Nfl6rV3Rr6�[*@=)?H1%5�rnP)?7 +1'*:JH*R"+a@E6�'�`PA���+-@E+1%:(N+->?)m� "C)O6�>O93HJ<=%0nv$#%#[� ��BDHJ<QFQ<=)O@=)?%32_+�[3<E+JRk@E)?R�+->�+-%5'�R"H1Z/[3<E6"936�%(7N)?:16C2J<E+1Z�Z_+1<�W

Page 66: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� © ���������� ������������������ ���� ��"!#��$&%'�

.�6"@S4(7YT(<L7�@S>OHPH1�U+-@i7=H1Z/6^H-B�@E936#R"H1%�\5)?Rr@E7i+-%('�7=[e6�Rr),+-> <E43>O687K�DBDH1<C7NHJZ�6KH-B@=9(6^RrH1%,\()?Rr@E7L�kWp.m+a@=6�<QFI6CFQ)?>O>0>OHPH1��+a@G@=936^+1[3[3<EHJ+JRL9�Wv W��IH1%�\(),Rk@I`56"@�FI6�6"%_@L+1+CBDHJ<=Z H-B�:16�<=`57t+-%5'�@=936iRrH1<E<E6�7=[5HJ%('*)?%32%3H14(%(7"u )�7NH1f@E+1+E+P)?7Q+�:16�<=`h�DZ/6�+1%3)?%32 ) @EH�7=>O6�6"[ +��G+17 F 6">?>�+17G+�%3H14(%h��Z�68+-%3)?%32/43%('36"<=f21<EH143%('�F +-@=6"<k�kWK�*)OZ/)?>?+1<=>?A ) �P9(+J+a@L+1+,+e:16�<=`~+-%('�) �P9(+J+a@L+1+,+5%3H14(%w��>O68'*216�<H1<Q+1R�RrH14(%J@k�kWz W��IH1%�\(),Rk@h`56"@�FI6�6"% A\+1+wBDHJ<=Z H-B�:J6"<E` +-%(' @=936wRrH1<E<E6�7=[5HJ%('*)?%32y%3H14(%(7"u) '*)?AJ+J+,+P)?%�qY)O%5'*)0R"+1%�H*R�Rr43<]+J7Q+#:J6"<E`h�D@=H_2J)O:J68�IH1<]+J7Q+#%(H143%s�D>,+-Z/[5�rW

y W��IH1%�\(),Rk@Q`e6r@�F 6"6�%�%(+J+^BDHJ<=ZjH-Bm:J6"<E`d+1%('�%3H143%57"u�)�7NHJ%(+1+E+PR�+-%�HPR�Rr43<]+J7G+:16"<E`��D@=H/7N>?6"6�[5�kn3+#:16�<=`(+1>5%(H143%h� @=9(6C+JRk@GH-Bm7=>?6"6"[()O%32P�kn*�a+-<EZ_+^H1B0:16�<=`�nPHJ<+17t+K%3H14(%b43%3<E6">,+a@E6�'/@EH#7=>O6�6"[���21HJ>?'(�rW�XG936]T(<L7N@I@E93<=6�6S7=6"%(7=6�7I+-<E6Y<E6">,+a@E6�'+-%('d@E936KRrHJ%�\(),Rk@L7Y+-<E6^7=AP7N@=6�Z_+a@=),R-WY�*)OZ/)?>?+1<SRrHJ%�\(),Rk@L7Y+-<E6>?)O�J6">?Ab@EH�H*R"Rr4(<)O%_Z_+-%PA#H-@=9(6"<IR�+17=6�7�WmXG936Y>?+J7�@IR"H1%�\5)?Rr@pBDH1<�@E936S7=6"%57N6^��21H1>,'(��),7 ) <L+-%('*HJZ9+93HaFI6�:16�<�W �PH�+->,7NHs+-<E6d@=936�R"H1%�\5)?Rr@E7�BDH1<�R�+17=6�7U� v �/+-%5' � z �/+-`eHa:16JW $l@7N93HJ43>,'U`56�[eHJ7E7N)?`3>?6K@EHd'*68+-> FQ)}@E9h7=A*7�@E6"Z_+a@E)?R#RrHJ%�\(),Rk@E7i`PA�216�%36"<L+-> <=4(>O687'*)?7ERrHa:J6"<E6�'h`PAs>O)?%3214()?7N@E7�MpBDHJ<K@E936b<L+-%('3H1Z RrHJ%�\(),Rk@E7�n�93HaF 6":J6"<8nm%3H~<=4(>O687+-<E6S6"VP[e6�Rr@=68'b@EH_FIHJ<=��+1%('d+�R�+17=6C`\A�R"+17=6i@=<E6�+-@=Z/6"%\@Q)?7]%36�R"6�7E7=+1<=AJW©5W��IH1%�\(),Rk@]H1B�:16"<E`(+1>�<=HPH-@]FQ)O@=9U%(H143%�u) 7E+-Z_+�(�9(+,+(R�+-%�H*R"R"43<Y+17Y+/:16"<E` � @EH43%('*6�<E7N@E+1%('(� +17GF 6">?>�+17Q+�%3HJ43% � @=9(6<=687N43>O@]H-B 43%('*6�<E7N@E+1%('*)?%32\�rW� W��IH1%�\(),Rk@L7�H-BC[(+-<L7=+1<=2\7^FQ)O@=9 %3HJ43%(7�nt:16�<=`57"np<E6">,+a@E)OHJ%(+->GF H1<L'37�np6r@LR-Wy{3HJ<6rV3+-Z/[3>?61np7=61np�P)?)�nt�16b>?)?A161np+1%('�[5+-<L+U%3H1<EZ_+->?>OAsH*R"R"43</+17#[(+-<L7=+1<=2\7"n `34*@7NHJZ�6"@=)?Z/6�7 @=9(6"A�+JRk@]+17GH1@=936�<]R"+-@=6"2JH1<EA/H-B�FIHJ<E'37�WXG936h+-`eHa:16��P)?%(' H1B#RrHJ%�\(),Rk@E7dR"+1% [eH-@=6�%\@=),+->?>OA `e6�@L+-�16�% R"+1<=6~H-B^`PA @=9(64*@L7=+1<=2\+af&+-[(+;:a+1+J'3+Q+-[([3<=H\+1RL9^)?%�FQ93)?RL9#@=9(6"<E6G+1<=6 ZK4(>}@E)O[3>?6Q>,+;A16"<L7mH-B5<E43>?6�7�W��YH1<=fZ_+-> <=4(>O687S+1<=6^)?%�>,+;A16�< v WiXG936#[3<EH1`3>?6"Z R"+J7N687"ne>?)O�J6^@=9(6#HJ%36�7SH14*@E>O)?%368'�+-`eHa:16JnF H143>,'�`e6U'*6�R">?+1<=68' +17�6"V*R"6"[*@E)OHJ%(7/+-%('�@=936�<=6�F H143>,'�`e6�<=4(>O687#)?%w>?+;AJ6"< z BDHJ<@=9(6"Z�Wpq]6�<=6),7Q+/7N�J6r@ERL9dH-B @=9(6>?+;AJ6"<L7pBDHJ<]q])?%('*) u

.m+;A16�< v � �i6�%36"<L+->mRrH1%,\()?Rr@Q<=687NHJ>O:J6"<k�kuv WG$lBpF H1<L'�)?7]BDH1>?>OHaF 6�'�`PAd[343<E6^[(+-<L7E+-<E2�� %3HJ43%�WK��FQ936"<E6 )��K+�7N9(HaF]7) FIHJ<E'�<=687NHJ>O:J6�7t@=H + �rW

z WG$lBtF H1<L'�)?7YBDH1>?>?HaFI68'�`\A�:J6"<E`�7N68c\436"%(R"6K+a@i@=9(6K6"%5'�H-B�@E936#7=6"%\@E6"%(R"6�xT(%5+->�:16�<=`d21HJ43[s�DZ/HJ7N@]>O)?�16�>OA3�rW

.m+;A16�< z ���*[568Rr)OT5R6rV3R"6"[*@E)OHJ%(7E�ru�$&%�R�+17=6CH-B0@L+-Zj@E+1+�HJ<QAJ+1+(uv WG$lB0BDHJ>O>?HaF 6�'�`PA9) 9P4(+1+E+�� :J6"<E`~�DZ/H\7�@G[3<EH1`(+1`3>OA3�rWG��o�V3Rr6�[*@=)?H1%b@=H/`e69(+1%('*>?6�'�+a@Q>,+;A16"< y BDH1<Q�P9(+J+a@L+1+�+17GZ/6"%\@=)?H1%(6�'�+-`eHa:16JW �z WG$lB�<=68'*43[3>?)?R�+a@E)OHJ%h��61W 2(W?n3�P9(+1+-@=6C�P9(+1+-@=68���x:J6"<E`�W

Page 67: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

����� �n����� �%VP$]� � $&%�� ��� �=� � �

y WG$lBG)OZ/Z/6�'*),+a@E6/[3<=6�:P)OHJ4(7iFIHJ<E'�)?7C�a+1+ � %3HJ43%w��Z/HJ7N@^>O)?�16�>OA3�kW���opVPfRr6�[*@=)?H1%d@EH�`e69(+1%('*>?6�'�+a@Q>,+;A16"< y BDH1<]7=H-@L+1+/+17GZ/6�%J@E)OHJ%36�'d+-`eHa:16JW ��]H1@=6d@=95+a@_6rV3Rr6�[*@=)?H1%57K@E9(+a@�>?6�+J'�@EHs>?+;AJ6"< y +1<=6�),'*6"%\@=)OT(68'�nI`(4*@�7N43)O@E+1`3>?6<E43>O687^+a@C@E9(+a@K>,+;A16�<C9(+;:16/%3H1@^`56�6"% F H1<E�16�'�H14*@8WbXG9(+-@@E+17=��<E6"Z_+1)O%(7iBDHJ<@=9(6BD4*@E43<=6JW#XG936�<=6�),7i+�%36�6�'�@=H�@E+-�J6#4([h7=A*7�@E6"Z_+a@E)?R�7�@E4('*)?6�7iH1%~@=9()?7C+-%5'�<E6">,+a@E6�'),7=7=436�7�W

�� �� �*0 ���^����!"� 8 !"� �_� � �V0�8� %(H-@=9(6"<�7=)O2J%3)}TeR"+-%\@�+17=[e6�Rk@_H1BSH14(<�+-[3[3<EHJ+JRL9�),7�@=9(+-@�FI6U'*Hs%3H1@�@E<=A�@=Hs216"@@=9(6/BD43>O>I7N6�Z/+1%\@=),R"7C)?Z�Z/68'*)?+-@=6�>OAJn0<L+a@=9(6"<C)}@^),7C6rVP@E<E+JRk@=68'�)?%s7�@L+-21687'*6"[e6"%5'*)O%(2H1% FQ9(6"% )O@#),7^Z/HJ7N@#+-[([3<=HJ[3<E)?+-@=6/@=H~'*H�7=H(WU{3HJ<K6rV3+1Z�[(>O6Jn )?% :16�<=` 2J<=HJ43[3)?%32H1%(>OAUX � X >,+-`e6">�),7CRr<E6�+a@E6�'�n�'*6"@E+1)O>?6�'�@E)OZ/6_+-%5'UZ/HP'(+->?)}@�A�)?%*BDH1<EZ_+a@=)?H1%�)?7i%3H1@6rVP@E<E+JRk@=68'�Wi$&%�B�+1Rr@�n�6rV3+1Z�[(>O687S7=43212J6�7N@]@=95+a@7N4(RL9�)O%*BDHJ<=Z_+-@=)?H1%�),7Y<L+a@E936"<CRrHJZ�f[3>?6rV +-%('�<=68cJ4()O<E6�7CBD4(<N@E936"<#[3<=H*R"6�7E7N)?%32�+-%5' RrH1%\@E6rVP@K6r@LR-W � [(+-<=@=),Rr43>,+-<�X � X>?)O�J6��N@E+1+ 936")�~��FQ<=)O@N@E6"%h+17��@L+1+�9(6")�3n���@E)O)�9(6")��'*6�[56�%('*)?%32dH1%�2J%3[5�iR"+1[*@=4(<=687:a+-<E)OHJ4(7G7N95+1'*687GH-B�Z�68+-%3)?%32\7Q+17G7N9(HaFQ%�`e6">?HaFv WQ<E+J+-Z_+KRL9(+J+;AJ+#[3)O@E+1+�936�)�WU]+-Zj'3<=)?%3�*7 @=68+3W�DH1<�UY+-Z 9(+J7G%3H/H1`�(�68Rk@E)OHJ%b@EH�'*<=)?%3�P)?%32�@=6�+\�

z W]7N434(<=A\+K[34(43<=:a+�Z/6%3)?�;+1>}@L+1+�936�)�WXG9367N43%�<E)?7=6�7G)?%�@=93668+17N@�W�D<E6rBD6"<L7I@=H_[e6"<E)OH*'*),Rr)O@�A�)?%U+#%5+a@=4(<E+1>�>?+;F >O)?�167=43%3<E)?7=68�y WQ[3<=)O@=9P:P)?)�7N434(<=A\+K�J6CR�+1+1<=H X @E+1<E+-B�+K2J9P4343Z^@E)O)0936") Wot+-<=@=9�<=6�:1HJ>O:J6�7 +-<EH143%('b@=9(6^7N43%0W�D<E6rBD6"<L7t@=H#R"H1%\@=)?%P43)O@�A�)?%�+K%(+a@E43<L+->e>?+;Fy>?)O�J6Y@E936i6�+-<=@=9bZ�Ha:P)?%32K<EH14(%('/@=9(67N43%e�©5WQ4(7=+1�16G`(+J+1'3+i<L+1+-Z_+S219(+1<E+ (N+J+a@E+J+i936")(+143<L+S457N6Q2J9(+-<L+Y`5+-%('3+CZ/)?>}@L+1+C936�)�W� B @=6�<Q@=95+a@�U]+-Z 21HP6�7G9(H1Z/6+-%('�936CT(%('(7G@=9369(H14(7=6C>OH*RL�168'�W�D)?%^@=9(6GR"H1%\@=6"VP@ H1B57�@EH1<EAC@=6�>O>?)O%(2(n-)O@ )?%('*),R"+-@=687mHJ%36 )O%(7N@E+1%(Rr6GH1B3@=936Q+JRk@=)?:P)}@�AH-Bm2JH1)?%32_+-%('bT(%('3)O%32P�� WQAJ+1'3)e:a+19(+/+1+a@L+1+#936")�@=H/@=4(Z/+�(N+J+-%(+J+3W$lB 936R"H1Z/6�7�n*A1HJ4�2JH(W�D)?%�+/R"H1%('*)O@=)?H1%5+->�7=6"%\@=6�%(Rr6C)O@Y7N)?21%3)OT(687Q+#HJ%36i@=)?Z/6K+1Rr@=)?:\)O@�A3�� WQ<E+J+-Z_+^�JH#@E6")?<=%5+1+/+1+-@E+1+#936�)�WU]+-Z �P%3HaF]7Q7=FQ)?Z�Z/)?%32(W�D)?%('*),R"+a@E6�7QR�+-[(+1`3)O>?)O@�A*�

Page 68: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ���������� ������������������ ���� ��"!#��$&%'�

�*WQ`3)?R�RL9P434d'(+-%3�a+�Z_+1+-<L+a@L+1+K936") W�*RrHJ<=[3)?H1%d7�@E)O%(2J7�W��7=93HaF]7I@=936^7ERrHJ<=[3)?H1% + 7 )?%3936"<E6"%\@]%(+-@=43<E6CFQ93),RL9�),7]7=)}@E4(+a@E)OHJ%d'*6�[56�%('*6�%J@S�# WQ<E+J+-Z_+^),7=+/7E+-Z_+;AJ+�'*4345'*9(+/[3)?)}@L+1+�936�)�W� @ @E93),7G@=)?Z/61n UY+-Zj'*<E)?%3�*7GZ�)?>?�eW��7=93HaF]7 9(+-`3)O@L�ª(WQ<E+J+-Z_+^)?%U'*)O%(H X '*4(4('*9(+/[3)?)O@E+1+�936�)�WXG936�7=6'3+;A*7�UY+-Z '3<=)?%3�*7GZ/)O>?��W��7=)O2J%3)}T56�7Q+-%�+1Rr@=)?:P)}@�A�FQ9()?RL9�),7G>OH*R"+1>O),7=6�'�)O%�<E6�Rr6�%\@ @E)OZ/6;�

XG9P4(7�n�+�7N)?%32J>O6KX � X >?+1`56�>�) @E+J+ 936�)>+e[3<EH*'*4(Rr687S+1>O>m@=9(6#+-`eHa:16#'*)}��6"<E6"%\@CZ/6�+-%3f)?%32J7�W$&%�Z_+1RL9()O%36�@=<L+-%(7=>?+-@=)?H1%sBDHJ<#$&%('3)?+1%�>?+1%32145+-21687"n )O@#F H143>,' `e6�7=4*��Rr)?6"%\@K@EH�16�6"[hX � X >,+-`e6">,7CFQ)}@E93H143@'3H1)?%32d+1%PA�7N6�Z/+1%\@=),R#+1%(+->?A*7N),7i[3<=Ha:P),'*6�'U@=936_Z_+-[3f[3)?%32QH-B3X � X�>,+-`e6">aBD<EH1Z�7NHJ43<LRr6�>?+1%32145+-216 @EH]X � X�>?+1`56�>1)?%S@E936�@L+-<E216r@�>,+-%(214(+1216RrHa:J6"<L7�@=9(6 7=6"%(7=6�7 7=[(+-%3%(6�'�W �p<E6">?)OZ/)?%(+-<EAi+1%(+->?A*7N),70+1Z/H1%32iq])?%('*) n-X06�>O432J4�n "+-%3f%(+J'3+/+-%('dXm+1Z/)O>�)?%('*),R"+-@=687 @=9(+-@])}@]),7Q)?%('*6"68'�7NH5W�� �� �b� � 0�� 6 0S��� ���V2!�]0 � 8

gh6�>O),7N@�`56�>OHaF 7NHJZ/6U[3<=HJ`3>?6"Z_7/<=6�>?+-@=)?%32h@=H R"H1%�\5)?Rr@E7_`e6r@�F 6"6�%w[5+-<L7=+1<=2\7#+1%('H-@E936"<K>O6"VP),R"+1>pR"+-@=6"2JH1<E)O687"n�BDH1<FQ93),RL9h@=936b7=H1>?4*@E)OHJ%(7C)O%s@E6"<EZ_7H-BQ7N4()}@L+-`3>?6_<=4(>O687<E6"Z_+-)?%b@EH/`56F H1<E�168'�H143@�Wv W ) 7=6[+3R�+-%d`564(7=6�'�+J7Q+�R"H1Z/[(+1<=),7N)?H1%�FIHJ<E'�W�{(H1<Q6"V*+1Z/[3>O6Jn

� �;�>�>z>{ � } ���2��{>z>{ ��{>{P��{ � }�7�!{ � � � �!{��;��;{��!����{ � z7��;}7� z>�.�!} � � � � ;{P� ��� } |!�� |����A�!}� ;{P���>�!���!{ � { � � � � � { � { � z7��;}7��|>�;�A�!}��7��} |!�� ��

$lB�) 7=6[+�),7S@E+-�J6"%h+17C+b[5+-<L7=+1<=2_936�<=6Jn�@=936_7=6"%\@=6�%(Rr6�F H143>,'U)?%('*),R"+a@E6"\(HaFI6�<+17G+-%�)?%(7�@E<=4(Z�6�%\@�u� � � �� !{P� |��;�A�!} �7�;} |!���������7� { � z>���}7�

��6"<E9(+-[(7KFQ936"% ) 7=6[+�),7�4(7N68'�+J7#+hRrHJZ/[(+-<E)?7=)?H1% F H1<L'�n�@=9(6"<E6d+1<=6�H1%3>?A +>O)?Z/)}@E6�'�%\4(ZK`e6"<_H-BiFIHJ<E'(7^@E9(+a@�R"+1% BDHJ>O>?HaF )O@�W .�)?%3214()?7N@E7_R�+-% Z_+1�16�+R"+a@L+->?H12J436SH1B 7=4(RL9dFIHJ<E'37�Wz W ) �P)?)>+3R�+-%�H*R"Rr4(<G+J7Q+/:16�<=`�W�{(H1<Q6rV3+1Z�[(>O6Jn��� � ��¥Y� � �E� � �;���8��� ¡ ��� � � ¥ �k¢ ¤ ����� ¥ �O�k� × �L��� �;��� �8¡�� � � �"!$#%�r¥&� � � ���I�8� � �?� ¤�¤ �'& ¥ �/¢ �_�

( �)� � ( �)� � � ���k�+* � �;�l� � � ×Q¥ ( �;� � � ¥ � � � ¥m¥ , � ¥ ( � ���k�-� � � � � ¥ �.� ¤�¥ � ¥ ����� ��¢ ¥ �Y��� ��¥ �)*0/1* � * � ��� ¥ � ¥� � �i¢ ¥ � � �1� ¤�¥ �i¢ � � ¥ � ¤ � � ���;  � � ¥k×w� � ¥2, � ¥ ( � ���k�1�'* !

Page 69: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

����� �n� � � ������� %C� ��*���#��� � � �

�;{7{P��{ � } �����!{ � { � } |!{7{,�;{ � �7� !{2� ��� } �!���!{ � ��� }��;{7zA� � }-� � ;{P� �;{>z.�!}-���;� �!���!{ � ��

$l@YZ/)O2J9J@i+-[3[e6�+1<Q@=9(+-@YH1%(6^F +;Ab@=Hb'3)?7N@=)?%3214()?7=9U`56"@�FI6�6"%�@E936@�F H_4(7=+121687)?7 @E9(+a@G@=9(6:16"<E`dHPR�Rr43<L7G+a@G@=9(66"%('dH-Bm@=936^7=6"%\@E6"%(R"6i4(%3>O)?�16i@E936[(+-<L7E+-<E2(Wgy936"% ) �P)?)>+�H*R�Rr43<L7S+-@C@=936/6"%5'�n�)O@R�+-%~H1%3>?A�`e6/+�:16�<=`0W'W 4*@FIHJ43>?'�@=9(6BDH1>?>OHaFQ)?%32/7N6�%J@E6"%(R"6C`56^R"H1%(7=)?'36"<E6�'d+-%d)O%(R"H1<E<=68Rk@]7=6"%\@=6�%(Rr6Ju�;{7{P��{ � } � ���;{7{�|!{ � {��,��� �����;{ � { � �>� !{2� ��� }`|!�>�A� ��}�{���!���;{ � � � �>�� ;{P� ��}�{���7�;} |;�>�A� � � �!���!{ � ��

y W ) [(+1<E+E+*R"+-%dH*R"R"43<]+17Q+�%3HJ43%�Wp{3HJ<Q6rV3+-Z/[3>?61n�A�!���>�;{A�!{>{,�;{ � {��;{ � } �A���A�>�;{c|!{ � {>{,�;{7{ �;};� {,�7�!� � � � }>{,�7�;}7� �>� } � �>�A�7����} ��{.�!} ������ �>�!� � � � {A�!} � { � �>���,����}������,� { � }�{��7�;}7� �

�]H-@E6i@=9(+-@�) [(+1<]7N6 +P@=HJ216r@E936"<]R�+-%�+1Rr@Y+17G[(+1<E7E+-<E2(W {3H1<Q6"V3+-Z/[3>?61n� {��7���;{>{ � { � ����{ � {,�;{ � } � ���>{,�;{>{ {7},�;� � z>{ � } �;}�{� ��� {,� ��� } � { �>� }-���� �;} {7}7��� � z>{ � } � { �>� }�� � � }7�7��}�{�� ��

©5W ) �J6�>?)?A16[+�R�+-%sH*R"R"43<^+17+d[(+1<E7E+-<E2 ) �16 +�BDH1>?>OHaF 6�'�`PA�@=9(6_:16"<E` ) >?)OAJ6[+?W�{3HJ<6rV3+-Z/[3>?61n� }�� � }���} {>{P� { �;{ � { �7� � {���}c�!} z�����} � �7�;} � } ��{ ��� �7} � ��} � �7� � }7} ��� �!} |!��� � �>�� � |!��� � ��� �7�;} � } ��{ � �,} � � �,���>} � �7� � }>} � ��

gh6t9(+;:J6pZ/6"%\@=)?H1%368'C@=9(6IRrHJ%�\(),Rk@�)O% ) @L+1+,+�BDH1<EZ_7�H1B(7NH1@E+1+Y+-%('�P9(+J+a@L+1+G:16�<=`57FQ93),RL9 +->,7=H~RrHJ<=<E6�7=[eH1%('~@=Hh%3HJ43%(7�WhXG936d.1g ��ZK457�@/Z_+-�16�@=936d<=)?219\@/RL93H1),Rr6JW�]HJ<=Z_+1>O>?A1n-'*6�[56�%('*)?%32CH1%�FQ936r@E936"<p+S[eHJ7N@=[eHJ7=)}@E)OHJ%#Z_+-<E�16�<mHJ<�+-%/+-4*V*)?>O),+-<EAC:16"<E`BDH1>?>?HaF]7�) �P9(+1+-@E+J+,+P�DH1<�)�7=H-@E+J+,+?n;BDH1< @=95+a@�Z_+a@N@E6"<k�m)}@tR�+-%K`e6]'*68Rr),'*6�'#FQ936r@E936"<�)O@�)?74(7=6�'_)?%/@=9(6Y:16�<=`�7=6"%57N6]HJ<p@E936Y%3HJ43%�7=6"%(7=61W�q]HaF 6":J6"<8n-@=9(6"<E6Y+-<E6Y7=H1Z/6][3<EH1`3>?6"ZR"+J7N687"W�$&%s@=936�7N6�%J@E6"%(R"6_`56�>OHaFnmBDH1<#6rV3+-Z/[3>?61n +U:16�<=` ) 9P4(+,+�BDHJ>O>?HaF]7 ) �P9(+1+-@E+1+E+FQ93),RL9�HPR�Rr43<L7 )O%U+�%3HJ43%U7N6�%(7N6JW

�>{�|!{ � } �>�!{>{,�;{7{c�>�!{ �;};� �x� }>}$�"�;{ � {������ {7{,�!�>� � � � ��}��>�;} � {>�>�7��� � � |;};� �>��� � z7}>} � � �,� �,�P� }�� � },� � � � �,}� �!{ � } { � {��7�7��� � � � ���7{ �>� �,� � z7}7} � ��

Page 70: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� # ���������� ������������������ ���� ��"!#��$&%'�

�� �� ���#�����"�98�!r���98$&%�@=93),7tRL95+-[*@E6"<8n-FI6G9(+;:J6Q+-<E214368'^BDHJ<�@=936Q%(6"6�'#BDHJ<p>OH*R�+->*F H1<L'K2J<=HJ43[(7�)?%�$&%5'*)?+1%>,+-%32J4(+-2J6�7Q@EH�9(+-%('3>O6#@=93H\7N6�43%3)O@E7C)?%hFQ93)?RL9~FIHJ<E'�H1<L'*6"<i)?7i)?Z/[5HJ<N@L+-%\@�WKXG9(6�7=6F H1<L'�21<EH14([(7_7N6�6"Z @EH `56U+-@_@=936U<E)O2J9\@/>?6":J6">Q`e6�R�+-4(7=6dT(<E7N@=>?A1nI@=9(6"A�+1>O>?HaF 4(7@=H�'*68+-> FQ)}@E9�),7=7=436�7SH-BI�;+J+-<L+-�a+_<EH1>?6#+J7=7=)O2J%3Z/6"%\@���)O%hRrHJ<=6#[(+-<L7N)?%32P�G43%3)OBDH1<EZ/>OA�D9(H1[e6rBD43>?>OA3�tBDH1<Q+1>O>�$&%('3)?+1%b>,+-%32J4(+-2J6�7�W��P68RrHJ%('*>?A1n\@=936�A�Z_+-�J6Y6rV3+JRk@=>?A/@=9(6i<E)?219\@�P)O%5'bH1B0)O%3BDH1<EZ/+-@=)?H1%d+;:;+1)O>,+-`(>O6Y@=H#@=936RrHJ<=6S[(+-<L7=6"<8Wmgh6C9(+;:16i+->,7NH#H14*@E>O)?%36�'b@=9(64*@L7=+1<=2\7�f&+-[(+;:a+J+1'3+�+-[3[3<EHJ+JRL9�@EH�21<L+-Z/Z_+-<^'*687N)?21%h@E9(+a@K),7[(+1<N@E)?R"43>,+-<E>OAh7N43)O@=68'BDH1<Q2J<E+1Z/Z/+1<Q'*6":J6">?H1[3Z/6"%\@8W

� JB�Q,N�� B H�� G��D��

XG936iRrH1%5Rr6"[3@IH-Bm>OH*R"+1>(F H1<L'_21<EH14([3)O%(2BDH1< $&%('*),+-%�>,+-%(214(+1216�7I'*),7=R"4(7=7=6�'�936"<E6),7#`5+17=6�'�H1% W 9(+1<E+-@=) 6r@�+-> W � v ªJª v �rnp+-%(' W 9(+-%P43Z_+-@=)� v ª # ª\�kW�{(H1</4*@E7E+-<E2J+-f+-[P:a+1'(+#+1[3[3<EHJ+1RL9�H-B���+a@L+-%:(N+1>O) n*7N6�6 "C)?6">?93HJ<=%s� v # #[� �kW �� � B�� D@R�� R

����� ZSH\687^AJH143<^Z/H1@=936�<@=HJ%321436b9(+;:16/>?HPR�+->pF H1<L'h21<EH143[57CBDH1<^:J6"<E`(7�� $lBQAJ6�7�nRL93HPHJ7=6Q+:16�<=`/+-%5'/)?'*6�%\@=)OBDA�+1>O>3[eHJ7E7=)O`3>?6]7=6�c\436"%5Rr6�7pH-B�+-4*V*)?>O),+-<EA^:J6"<E`(7�@=95+a@tR"+1%BDH1>?>?HaF )O@�W����� $&%#@=936G:16�<=`�+-%('#)O@E7�+-4*V*)?>O),+-<E)?6�7 A1HJ4^9(+;:16 ),'*6"%\@=)OT(68'K)?%�opV*6"<LRr),7N6I©(W v naFQ9(+-@+-<E6i@=936^+121<E6"6�Z�6�%\@ <E43>?6�7�W����� gh<=)O@=6�+_>OH*R�+->0:J6"<E`U21<EH143[()O%32_[(<=HJ21<L+-ZjAJH143<L7=6">OB HJ<Y4(7=6#+1%U6rV*)?7N@=)?%32�[(<=H1f21<L+-Z �D61W 2(W?n1>?H*R"+1>*FIHJ<E'#21<EH143[e6"<�[5+1RL�a+-2J6 HJ<�T(%3)O@=6]7N@E+-@=6QZ_+1RL93)?%36Q[(+JRL�a+-216G7=4(RL9+17C.mo��i�]@=95+a@C4(7N687S@=936/<E43>O687iH1`*@L+-)?%36�'U)?%so�V*6"<LRr),7N6#©(W z @EHbBDHJ<=Z :J6"<E`�21<EH143[57)?%�+1%�)?%3[343@S7N6�%\@=6"%5Rr61W��� � Xm<=A�@EH�Z_+-�J6#+dR"+-@E+->?H12�H-Bt6"V3Rr6"[3@=)?H1%(7SFQ936"<E6#@=936/[eHJ7N@i[eHJ7=)}@E)OHJ%�Z_+-<E�16�<R"+1%_`56Y4(7N68'_+17I+C:16"<E`_H1<t%3H143%_6"@ER1W � +1%_A1HJ4/7=432J216�7N@t+936�43<E)?7N@=),RG@=HK<=68RrH12J%3)��"6FQ936�%d)O@]),7Q+#Z_+1<=�J6"<Q+-%('dFQ936�%�%(H-@��

����! ghH1<E�KH1%_HJ%36QH-B�@E936]H1[e6"%_[(<=HJ`3>O6�Z_7�)O%b�*6�R-W ©(W � W � +-%/AJH14_RrHJZ�6Y43[_FQ)}@E97=H1Z/6C936"43<E),7�@E)?R�7 BDH1<Q<E6�7=H1>?:\)?%32#@=936^R"H1%�\5)?Rr@�W

Page 71: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� �

� � � � � � ��� � � �

�/ �� ��������������� ��!"�#�q]HaF ),7 )}@ @=95+a@�%(+a@E43<E+1>J>,+-%(214(+1216p),7 4(7N68'^`PA7N[e6�+1�16�<E7�@=HCRrH1%P:J6"Ai)O%*BDHJ<=Z_+-@=)?H1%@EH@=9(6]936�+1<=6�<E7���q]HaF )?7p)}@I@=9(+-@tH1%/9368+-<E)O%32^+1%/4*@N@E6"<L+-%(R"61nJ@=936]9(6�+-<E6"<L7�+-<E6]+-`(>O6G@EH216"@G@=936)?%\@=6"%5'*6�'d)?%*BDH1<EZ_+a@=)?H1% �UXG936�7=6+-<E6Y@E936^c\436�7N@=)?H1%57 @=9(+-@]9(+;:16C)?%J@E<=)?214(6�'��+-%()O%3),+-%57"W XG9(6�21H\+->QH-BC@E936���+-%()O%3),+-% +-[([3<=H\+1RL9w)?7_@=H R"H1%(7N@=<E4(Rk@b+h@E936"HJ<=AH-B]9P43Z_+1% %(+a@E43<E+1>t>,+-%32J4(+-2J6�RrHJZ�Z#43%3),R"+-@=)?H1%s@=95+a@�+1%(7=FI6�<E7C@E936�7=6�c\43687�@E)OHJ%(7�W�i<L+-Z/Z_+-<8n�+b[(+-<=@CH-BI7=4(RL9�+b@=936�H1<EA�H-BIR"H1Z/ZK43%()?R�+a@=)?H1%0ne),7C+�7=A*7�@E6"Z H1Bt<=4(>O687@=95+a@_6�7N@E+1`3>O),7=936�7/+~<=6�>?+-@=)?H1% `e6r@�F 6"6�%�FQ95+a@�@=936U7=[568+-�16�<_'*6�R")?'*687#@=H 7=+;A +1%('93),7_4*@=@=6"<L+-%5Rr61nG+-%5'w7=)?Z�)?>,+-<E>OAJnIFQ9(+-@_@=936U9(6�+-<E6"<_9(6�+-<L7/+-%('�@E936�Z/6�+1%3)O%(2h9(66rVP@E<E+JRk@E7�W XG936/Z_+-)?%~[(<=HJ`3>O6�Z @=936_��+1%3)O%()?+1%~+-[([3<=H\+1RL9�+J'3'*<E6�7E7N687i)?7C93HaF @=H�6rVP@=<L+1Rr@�a+-<L+-�a+^<E6">,+a@E)OHJ%(7C�DFQ93),RL9�+-<E6i7=AP%J@L+1Rr@=),RrH-f&7=6"Z_+-%\@=),R]<E6">,+a@E)OHJ%(7L��BD<EH1Z +�7N6�%\@=6"%5Rr61W� 7�)O@�)?7�)?%(7=[3)?<=68'^`PA^+-%�)O%,\(6�Rr@=)?H1%(+1>O>?A<=),RL9K>,+-%(214(+12161n;)O@p6"Z/[39(+J7N)��"687m@=936G<EH1>?6�7mH-BR"+J7N6t6"%('*)?%32\7m+1%('Z_+-<E�16�<E7�7=4(RL9^+J7�[eHJ7N@Nfl[5H\7N)O@=)?H1%(7 �DHJ<0[3<E6"[eHJ7=)O@=)?H1%(7L�kW ��HJ7=)}@E)OHJ%(7H1<QF H1<L'�HJ<E'36"<G)?7]`3<=HJ43219\@G)O%\@EH�RrH1%57N),'*6"<L+a@E)OHJ%bHJ%3>OAbFQ936"%�%368Rr6�7E7E+-<EA1W� Z_+:(�HJ<=)O@�A�H-BG9P43Z_+-%h>?+1%32145+-21687i)O%(R">O45'*)O%(2�$&%('*),+-% +-%5'~H1@=936�<>?+1%32145+-216879(+;:J6�<=6�>?+-@=)?:16�>OA BD<=6�6�FIHJ<E' HJ<E'36"<8W $&%yBD<=6�6�F H1<L' H1<L'*6"<�>,+-%(214(+1216�7�nGH1<L'*6"<bH-BF H1<L'37QRrHJ%J@L+-)?%(7GH1%(>OAd7N68RrH1%5'3+-<EA�)?%*BDH1<EZ_+a@=)?H1%�7=4(RL9U+17Q6�Z�[(9(+17=)?7]6r@ER1WI�t<=)?Z_+-<EA)?%*BDH1<EZ_+a@=)?H1%�<=6�>?+-@=)?%32�@EH ) 2J<=H\7=7 +0Z/6�+1%3)?%32w��61W 2(W?ntHJ%36b@E9(+a@_)?%(Rr>?4('*687_7N6�Z_+-%\@=),R��� * � *�� ��×]�L£ ����� �;� ��×]� �l� � � � � ¤ �K�L��� � � � � � � �"� �8� �1� £ ��� � � ��� �"� ( ¥�¥�� � �-# ����� � ( �E� ����� � � ¥��� ¦D� � � �;�k� �L� � �;���0�l� � ( ��¥ � *� �0� ¥ � ¥ ��� � �8� � ¥ � ¥ �8� ¥ ¢ ¥�� & ¥N¥ � � � ¥  k� �L¤ ���L��� � �;���;� � � � (1( ��� � �l�K�k� � � ¥ �k� ¥ � � �1� � �1�� §��8� × � £��"� � !   ¥ � ¥ � �E� � � ¥ ¥ � � ¥ � ( � ��� ¥ �k� � � ¥ � � � ¥ � * �0� ¥ ¤ �E��� ¥ �����m��� ��¥ � ¥ � ��¥ �K������ ¥ � � � � � ���; � � ¥ ���;� �E� ¥ �;�;� � ¥ � � �L¤  k� ��×>×]� �0��� � � ¥S× ���1�C�L� ¥ � ¥ � � ��� ×]� �� �;� ¤ �¢ � &m�8���l�^� ¥ �k� � � ¥ � �¥ �1�k� ��¤�¥ �.� ¤ �Y� �1� &0� � �8�)� ��¥2, ( ¤ ����� ��� � � �k� ���;  � �'��;��� ¥ � ¤ � �; )� �   ¥�� � �E� � ¥ �k��� � ¥ ��� ¥ , ( �)� ¥ � � �1*

� ª

Page 72: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�[� ���������� � ��� ��%�$&%$&�% � �� � � ��

<E6">,+a@=)?H1%57N93)?[(7L�i)?7#RrHJ%J@L+-)?%36�'s6�>?7=6"FQ9(6"<E61W�$&%�RrHJ%J@E<E+J7�@@EHU@=9(6�>?+1%32145+-21687"nmZ/HJ7N@6rV*),7�@E)O%(2]RrH1Z/[343@E+a@E)OHJ%(+->121<L+-Z/Z_+-<L7e+1<=6�`(+J7N68'iH1%^RrHJ%\@=6rVP@�BD<E6"6�2J<E+1Z�Z_+1<E7eFQ93),RL9+-<E6U`(+J7N),R"+1>O>?A�[eHJ7=)O@=)?H1%(+1>]21<L+-Z/Z_+-<L7"W XG93687N6�+1<=6~'*6�7=)O2J%36�'wBDHJ<�>,+-%32J4(+-2J6�7_)?%FQ93),RL9�[eHJ7=)}@E)OHJ%�H-Bt+�RrH1%57�@E)}@E436"%\@C)O%�+�7N6�%\@=6"%5Rr6#R"H1%\@E+1)O%57]�16�A�)O%*BDHJ<=Z_+-@=)?H1%�WS$l@),7^)?Z�[eH1<=@E+1%\@@=H�'*6�:16">?H1[ +�7=43)O@E+1`3>O6�R"H1Z/[34*@L+a@E)OHJ%(+->p2J<E+1Z/Z/+1<CBDH1<EZ_+->?)?7=Z|BDHJ<BD<E6"6CFIHJ<E'�H1<L'*6�< >,+-%(214(+1216�7IBDHJ<G@�FIH/<E6�+17=H1%57"uv W � 7N43)O@E+1`3>?Ah'*687N)?21%(6�'~BDH1<EZ_+->?)?7=Z FQ)?>O>t`56�Z/HJ<=6_6"�_R")O6�%\@K`568R"+14(7N6_)O@KFQ)?>O>`56^+1`3>O6i@EH�Z_+1�16C4(7=6H-Bm[(<=)?Z_+-<EA�7NHJ43<ER"6�7GH1Bm)?%*BDH1<EZ_+a@=)?H1%�'*)?<=68Rk@E>OAJWz WY�P4(RL9~+bBDH1<EZ_+->?)?7=Z )?7+1>?7=Hb>?)?�16">?A�@=Hd`e6�>?)?%32143),7N@=),R"+->?>?AdZ/HJ<=6�6">?6"2\+-%\@i+1%('7=+-@=),7�BDAP)?%32(WG�P)O%5Rr6^)O@SFQ)?>O>m`56#+-`3>?6C@=H�<E6">,+a@E6C@=H�[(<=)?Z_+-<EA�7=H143<LRr687GH-B�)O%3BDH1<=fZ/+-@=)?H1%�nm@=9(6b21<L+-Z/Z_+-<),7^>?)?�16">?A~@=H�`e6�Z/H1<E6_6�R"H1%3HJZ�),R"+1>t+-%5's6�+17=)?6"<@EHFQ<=)O@=6JW$&%@E93)?7 RL9(+1[*@=6�<�n;F 6t'*6�7ERr<E)?`56 7N4(RL9#+GBDH1<EZ_+->?)?7=Z�n;R�+->?>O68'C@=9(6I��+-%()O%3),+-%CBD<L+-Z/6"fF H1<E�en\@E9(+a@]9(+J7G`56�6"%U7=4(R"R"6�7E7�BD43>?>?Ab+-[3[(>O)?6�'�@=H/$&%('3)?+1%d>,+-%(214(+1216�7�W

�/ .- ���90 �*0 ���^����!"��� ���70 �$&% @E93),7U7N68Rk@=)?H1%0nYF 6h'*687=R"<=)?`e6�@E936s6">?6"Z/6"%\@E7dH1B^@=936 7=6"Z_+-%\@E)?R~Z/HP'36">C)O% @=9(6��+-%()O%3),+-%bBD<E+1Z/6"F H1<E�eWop:J6"<EA/:16"<E`(+1>�<=HPH-@^��'*9(+1+-@=45� '*6�%3H-@E6�7]+1%d+JRk@E)OHJ%dR"H1%(7=)?7N@=)?%32/H-B�uv W]+-%�+1Rk@E)O:P)O@�A���+�:PAJ+J+-[(+J+-<L+J�rn\+1%('z W]+#<E6�7=43>O@^��+/[39(+1>?+\������ ���(),7t@=936C7�@L+a@E6YFQ93),RL9�FQ936�%b<E6�+1RL9(6�'�nJ@=936i+1Rr@=)?H1%�),7GRrH1Z/[3>?6r@E61W���������������RrHJ%(7=)?7N@E7�H1B�+JRk@E)OHJ%(7pR"+1<=<E)?6�'#H14*@p`PA#'3)}��6"<E6"%\@t[(+1<N@E)?R")O[5+-%\@E7�HJ<������ ���!�"�$#S)O%P:1HJ>O:J6�')?%�@E936^+1Rr@=)?H1%�W� % +JRk@=)?H1%h),7C4(7N45+->?>OA�+�R"H1Z/[3>?6rV~FQ9()?RL9sR"+1%~`e6_`3<EH1�16�%~)?%\@=HU7=43`*f&+1Rk@E)OHJ%(7�W{3HJ<�6rV3+-Z/[3>?61nJ)O%�@E936QH1[e6"%3)?%32H1B�+i>?HPRL��n\+S[e6"<L7=H1%�)O%(7=6"<=@E7t+S�J6"A^)?%/@=9(6Q>OH*RL�K+1%('@=4(<=%(7i)O@�n�@E936/�16�AUH1%�)O@E7i[(+1<N@C[3<E6�7E7N687]@E936/>O6�:16�<E7i+-%('~Z/Ha:1687]@E936"Z�n�@E936#>,+a@LRL9)?%�@=4(<=%�Z�Ha:J6�7�+-%('�@=936d>?HPRL�sHJ[56�%(7���{ )O2J43<E6 � W v �kW ot+JRL9�H-B]@E936�7N43`3fl+JRk@=)?H1%57�D6JW 25WOne)?%(7N6�<N@E)O%(2b+-%('d@E43<E%3)O%(2�+_�J6"A1n(@=936#�16�A�[3<E6�7E7=)O%32�+1%('UZ/Ha:P)O%(2/@=936#>O6�:16"<L7�n@=9(6Y>,+a@ERL9_Z/Ha:P)?%32^+-%('�@E936Y>?H*RL�KHJ[56�%3)O%(2\��95+17p)O@E7tHaFQ%�7N6�Z_+-%\@=),RG<=6�>?+-@=)?H1%(7tFQ)}@E9+17E7=HPR")?+-@=68'�H1`,(�6�Rk@L7"W� %(H-@=9(6"<Y)?Z/[5HJ<N@L+-%\@iR"H1%(R"6"[*@i)?7Y@=95+a@SH1Bp:P)O:a+-�*7=9(+3W&%'���(���(� )*�#<=6"BD6"<L7Q@EH�@=9(67=[568+-�16�< + 7�:P)O6�FQ[5HJ)O%\@tHJ<p+a@=@=)O@=4('*6Y@=HaFG+-<L'37 @=9(6Y+1Rr@=)?:\)O@�A1W � 7=6"%\@=6�%(Rr6Q),7p%(H-@pH1%(>OA+b7N@E+-@=6�Z�6�%\@SH-B +-%�HJ`�(�6�Rr@=)?:16K+JRk@=)?:P)}@�A�`343@C+1>?7=HbRrHJ%\@E+-)?%(7S)O%3BDH1<EZ/+-@=)?H1%U<E6"2\+-<L'Pf)?%32�@E936d7=[e6�+-�J6"< + 7K:P)O6�FQ[5HJ)O%\@�W � �S)O:a+1�P7=9(+~7N93HJ43>,' %3H-@/`e6�RrHJ%*BD4(7=6�' FQ)}@E9�@=9(6

+ � � � �L£L� ( � �k�;�)�8�;� ¥ � � ��� £E�k� � �L£-¡ ��� � ¥-, � ¥ � ¤ �E��¥ �'*

Page 73: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,����� ��� � �%"P$]� ��������� �(v

������������ ������������������������������ ����!�"#%$&�����

�����������('�������(")*$&�����+��,$-��.0/���,1���.2�3/2/2�����)�4�������/5�

�������6����87%��69�.0�������:�;���,1����/<�=.<������:�����

4�����������:�>?������

{ )?2143<E6 � W v up�\@=<E4(Rr@=43<E6CH-B�+-%�+1Rk@E)OHJ%

7=[568+-�16�< + 7S)O%\@=6�%\@=)?H1%(7iFQ93),RL9~R"H1Z/6#4(%('*6"<C[3<L+-2JZ_+a@=),R"7�W�� �S7N4(+1>O>?A1n�:P)?:a+-�*7N95+b+aB fBD6�Rr@E70@=936GRL93HJ)?R"6pH-B3:J6"<E`CBDH1<EZ�FQ9()?RL9�n;)?%^@E43<=%0n;+-�e68Rk@L7�@E936 RL9(H1),Rr6pH1B3[(+-<=@=),Rr)?[(+-%\@L7+-%5'�@E936")?<]<E6">,+a@=)?H1%dFQ)O@=9�H1<G<EH1>?6i)?%d@=936^+JRk@E)OHJ%�W� 4*@QH-B�+->?>�@=9(6[(+-<=@=),Rr)?[(+-%\@L7I)?%U+-%�+1Rr@=)?H1%�nP@E936"<E6)?7GHJ%36CFQ93H_),7�) 7=F +-@E+1%J@E<E+E+H1<KZ�H\7�@^)?%('*6�[56�%('*6�%J@8n�+-%('h),7^R"+1>O>?6�' �!�(���-�A@b�a+1<E+1�;+(WbXG9P4(7�nm)?%h@=936_BDHJ>O>?HaFQ)?%327=6"%\@=6�%(Rr687"u� � � �;} |;�,� � � } � }-� �7�;}�z>���.�� � � �;} �;}7� � � } � }-� �7�;}�z>���.�� CB � �;} z7���.� � � } � }-� @=9(6�;+1<N@L+�)?7�n*<=687N[e6�Rr@=)?:16�>OAJnP@=936`eHaA1nP@E936�16�A1n3+-%5'b@E936>?HPRL��WXG936C��+-%3)?%3),+-%b@=936�H1<EA�RL93HPHJ7=6�7I@=H#@E+1>O��)?%�@=6"<EZ_7GH-B0�a+1<N@L+K)?%(7N@=6�+J'bH1B +1216"%\@8W$l@C)?7i%3H1@ (�4(7N@+�RL9(+1%3216K)O%~%3H1Z/6"%5Rr>,+a@=4(<=6Jne`(4*@^+17Y@=936/+-`eHa:16#6rV3+-Z/[3>?6#7=93HaF]7�n�a+-<=@E+/+-%5'�+1216"%\@]+-<E6C'*)}��6"<E6"%\@])?%�216"%(6"<L+-> W� R�RrHJ<E'*)?%32�@EH "+-4(%('*`39(+-@N@L+3n FQ93H�BD43<=@=9(6"<K6�>?+1`5HJ<E+-@=687H1% @E936�R"H1%(R"6"[*@#H-B7=F +-@E+-%\@E<E+(nm6�:16"<EAh:16"<E` )?% +�7=6"%\@=6�%(Rr6�<=6"BD6"<L7@EH~+�R"H1Z/[3>?6rV H-BY+JRk@=)?:P)}@�AJW~{(<=6"fc\436"%\@E>OAJn393HaF 6":16�<�n\@E936K7E+-Z/6C:16"<E`UR"+1%�`e6^4(7=6�'�@=H_<E6rBD6�<G@=H_%3H1@]H1%3>?A�@E936Z_+-)?%+1Rr@=)?:P)}@�A`343@t+->,7NHY@=H7N4(`*f [5+-<=@E7 H-B5@=936QRrHJZ/[3>O6"V�W D "+-<=@E+]H1Be+S:16�<=`#)O%/+S7=6"%\@E6"%(R"6),7GH1%36FQ93),RL9d)?7 @E936 ) +J+17=93<L+;AJ+,+\H1<G>?H*Rr4(7QH1B0@E936^+1Rr@=)?:\)O@�A1W�XG9P4(7�n3)?% � W v @E936^+1Rrf@=)?:P)}@�A�<E6rBD6�<=<E6�'d@EHb),7Y@E936#+JRk@iH-BpH1[e6"%()O%32�H-B�@E936#>?H*RL��`\A�@=9(6#`eHaA�`\A�)?%(7=6"<=@=)?%32+��16�A�+-%5'�@E43<E%3)O%(2U)}@8n 6"@ER1W~��+JRk@E)OHJ% v )?%�{ )O2J43<=6 � W v �kWbXG9P4(7�n�@E936�`eHaA�),7C@=9(6E � � � � � ��� ( � �k�;�)�8�;� ¥ �^� £L� � � �k�8¡ *F � � ×Q¥&� � ×Q¥ � � � ¥ � ¥ � ¢C� � �¢ ¥t��× ¢;�� )�8�)�1� # ��� &m�8���l�� � � ¥ � �G×]� � � ¥ � ¥ � � �Q�k� ¥ �L� � ¥ � ¥ � �L¤� � � ���k�-� *0Gd� ¥ � �-� ¥ �i��� � � ¥ � � ¥ �;� ¥)# � �c×]�'� � ¥ � ¥ � � � � � � �k� ¥ �L�3� � � ( �)� ����¢ ¤�¥p� � � ���k�-� *

Page 74: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�Jz ���������� � ��� ��%�$&%$&�% � �� � � ��

�a+-<=@E+dH-BG@E93)?7K+1Rk@E)O:P)O@�A1W�$&% � W z n0@E936�+1Rr@=)?:P)}@�A~<=6"BD6"<E<=68'�@EHU)?7^@=936_[3<E6�7E7=)O%32U+1%('Z/Ha:P)O%32/H1Bm@E936^>?6":16�<E7G`PAb@=936�J6"A�R�+-4(7=)?%32�@=936>?H*RL��@=H_HJ[56�%�n36"@ER-Wi��+JRk@=)?H1% z )?%{ )O2J43<E6 � W v �kW^XG936 ) �J6"A +�)?7S@E936#�a+1<N@L+bH1Bp@=93),7C+1Rr@=)?:\)O@�A1W$&% � W y n�@E936/+1Rk@E)O:P)O@�AU)?7@=95+a@tH1B�Z/H1@=)?H1%_H-B�@E936Y>,+a@LRL9�+-%('�H1[e6"%()O%32KH-B�@=936S>OH*RL�d��+1Rr@=)?H1% y )?%�{ )O2J43<E6 � W v �rWq]6�<=6Jn3@E936K�a+-<=@E+/),7Q@E936K>?H*RL��W $&% � W v @=936#7N[e6�+1�16"<S'*6�R")?'*687Q@EH�21)?:16^)?Z/[5HJ<N@L+-%(R"6@=H/@E936<EH1>?6SH1Bm@E936`5HaAJn*FQ936"<E6�+J7G)O% � W z @=9(6^7N[e6�+1�16"<QFQ),7=936�7 @EH�6�Z/[39(+17=)��"6C@=9(6<EH1>?6]H-B�@E936S�J6"AJW � �N$l@G)?7���) � �p�16�A#FQ93),RL9�HJ[56�%36�'/@E936i>OH*RL��� �\��$&% � W y @=936i7N[e6�+1�16�<6"Z/[395+17=)���6�7@E936�B�+JRk@#@=9(+-@K@=9(6�>?H*RL�~9(+J7^`e6"6�%�H1[e6"%368'�MtFQ9()?RL9��J6"AhH1[e6"%368' )O@+-%5'UFQ93H�HJ[56�%36�'U),7S43%3)?Z�[eH1<=@E+1%\@i+17YB�+-<i+17]@=9(+-@S4*@=@=6"<L+-%5Rr6K),7iRrH1%5Rr6"<E%368'�W � 7BD43<=@=936�<]6":P),'*6"%5Rr6@E9(+a@]@E936K7E+-Z/6C:16�<=`O) H1[e6"% +5<=6"BD6"<L7 @=Hb'*),7N@=)?%(Rk@S+JRk@E)OHJ%(7^�D9(HaFGf7=H\6�:16�<I<E6">,+a@E6�'_@E936"A_Z/)?219\@Q`56;�kn*%3H1@=6i@=95+a@G)O%�+K>,+-%(214(+1216Y>?)?�16Cq])?%('*)�@=9(6"<E6S),7G+'*)O�e6�<=6�%\@]FIHJ<E'�BDH1< ) H1[e6"% +()?% � W y +17QRrHJZ/[(+-<E6�'�@=H � W v +1%(' � W z WG�P6"6'WiW v nEWiW z+-%5' WiW y `e6">?HaF BDH1<]q])?%('*)m7N6�%J@E6"%(R"6�7�W� � �����!{ � { � } �;{>{>z7{>{ ���;�>z>{>{

�!���!{ � ��� } z>���.� � � } � }-�� �!���;{ � � � } � }-���7�;}�z>���.� �

� � � � { �7{>{�|��7� � } �;{7{>z>{>{ ���!�>z>{7{ � ��� � �!}7� ��� } z7���.� � � } � }����� ��� � �!}7� � � } � }-� �,�;} z>���P� �

� CB��;{>{>z7{>{`���>�;z>{ � {,��{>{ z>���.� � � } � }-���� �;}�z>���.� � � } � }-� ��

XG936_%3H1@=)?H1%sH-BQ�a+-<L+-�a+d<E6">,+a@=)?H1%57C)?7#Rr6"%\@E<E+1>�@=HU@E936b��+-%()O%3),+-%hZ/H*'*6"> WdXG9(6�a+-<L+-�a+/<E6">,+a@=)?H1%57]+-<E6K7=A\%\@L+1Rk@E)?R"H-f&7N6�Z_+-%\@=),R_�DHJ<Y7N6�Z_+-%\@=),RrH1fl7=AP%J@L+1Rr@=),R�� <E6">,+a@=)?H1%57`e6r@�F 6"6"%�@=9(6U:16"<E`(+1>?7/+-%5'�H1@=936�<_<=6�>?+-@=68'�R"H1%(7N@=)O@=436�%\@E7/)?% +s7=6"%\@=6�%(Rr6JWyXG936"AR"+1[*@=4(<=6h+�Rr6�<N@L+-)?% >O6�:16�>YH-BK7=6"Z_+1%J@E)?R�7"W W 4*@b@E93)?7d),7�@E936�>?6":J6">iH-BK7=6"Z_+-%\@E)?R�7@=95+a@^),7C)OZ/[eH1<=@E+-%\@^7=A\%\@L+1Rk@E)?R�+->?>OA~+-%('~)?7C<E6 \56�Rk@E6�'h)?%~@E936_7N4(<NB�+JRr6�BDH1<EZ|H-B @=9(67=6"%\@=6�%(Rr6\��7L�kWp{ )O2J43<E6 � W z 7=93HaF]7I@=936<E6">,+a@E)OHJ%(7=93)O[0W$&%�{ )O2J43<E6 � W z n(@=936�7N43<=B�+1R"6>O6�:16�>0),7]@E936^4*@=@=6"<E6�'�H1<]FQ<E)}@=@=6�%�7N6�%\@=6"%5Rr61W]XG9(6:P)O`(9(+-�\@=)I>O6�:16�>t),7^@E936b>?6":J6">I+-@KFQ93),RL9s@=936�<=6d+-<E6_>OH*R�+->tF H1<L'h21<EH143[57`(+17=6�'sHJ%R"+J7N6Y6"%('*)?%32\7"n\[3<E6"[eHJ7=)}@E)OHJ%_H1<t[eHJ7N@=[eHJ7=)O@=)?H1%�Z_+-<E�16�<E7�W � �Y)?`39(+1�J@E)eBDH1<t%(H143%(7I9(+J7+->?<E6�+1'3A�`e6"6�%U'*6rT(%(6�'�6�+-<E>?)O6�<�W � %3H143%d21<EH14([b),7Q+K43%()}@YR"H1%\@E+1)O%3)?%32�+#%(H143%s�DHJ<+�[3<EH1%3HJ43%�n*[3<EH1[e6"<Q%(+1Z/61n*6r@LR-W��kn3)O@E7]:\)?`39(+1�\@=)�+-%5'�[eHJ7E7=)O`3>?Ab7=H1Z/6+1' (�68Rk@E)O:J6�7�W�Y)?`39(+1�\@=)eBDH1< :16�<=`(7IR"+1%b`e6i'*6"T(%368'b7=)OZ/)?>?+1<t@EH^@=95+a@ BDH1<I@=936i%3H14(%(7"W � 936�+J':16�<=` Z/+;A `e6�BDH1>?>OHaF 6�' `PA�+14*V*)O>?)?+1<=As:J6"<E`(7���FQ93),RL9 Z_+;A <=6�Z_+-)?% +17/7=6"[(+1<E+-@=6F H1<L'37 H1<�Z_+;A^RrH1Z#`3)?%36GFQ)}@E9K@E936Q936�+J'^:J6"<E`5�kW��P4(RL9�)O%3BDH1<EZ/+-@=)?H1%#)?7�R"H1>?>O68Rk@=)?:16�>OAR"+1>O>?6�'C:P)?`39(+1�J@E)-BDHJ<�@=9(6t:16�<=`0WmXG936p:P)?`39(+1�J@E)-BDHJ<m+Q:J6"<E`21)?:16�7�)O%*BDHJ<=Z_+-@=)?H1%^+-`eH143@@=6�%(7=61n5+J7N[e6�Rr@S+-%5'�Z�H*'3+1>O)O@�A~��X � X��kn�+-%5'�)?7�n3@E936"<E6rBDHJ<=6Jn5+->,7=H�R"+->?>?6�'�@=936�X � X>,+-`e6"> W�X � X >,+-`e6">,7I+1<=6S[343<E6">?A/7=AP%\@E+1Rr@=),RY'*6"@=6�<=Z/)?%36�'�BD<=HJZ�@=936i:16�<=`_BDHJ<=Z +1%('@=9(6^+-4*V*)?>O),+-<E)O687"W���a�k� ( �)��� � ���k� �L¤8¤ � �; )� �   ¥ � �.�;�l� � ���5�;  ¤ ��� � # � � &��)� ¤ � �L¤ � � ���8� ¤ �-� ¥ ( �)� � � ���k� �k� &��k�.�I�k�.� ¥ ����8�O�k� ×]�E� ���k�+*

Page 75: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,����� ��� � �%"P$]� ��������� ��y

�7�>� � }.� { � �!�>��z,} � }�z � �>�!{,���,�;} �A� }>{A�!}7���!{ � � � �� � � ���

�7�>� ��{,��{A��{�z7} � }�z��

�7�>� � �A|7�!{A�;�!��z,} � }�z��

�7�>� � ��� � {��,} z,} � }�z � �>�>��}7��}�� � } � ��} � �,}%�

{ )?2143<E6 � W z up.�6�:16�>?7 )?%�@E936^��+-%()O%3),+-%�Z/HP'36">

XG936_:P)?`39(+-�\@E)�>O6�:16">I+-`(7N@=<L+1Rr@E7+;FG+;A�BD<EH1Z Z_+-%PA�Z/)?%3H1<���)O%(R">O45'*)O%(2UH1<=@=93H1f21<L+-[(93)?RY+-%('b)?'*)?HJ7=AP%(Rr<L+a@E)?R8��'*)O�e6�<=6�%(Rr687G+-Z/H1%32K>?+1%3214(+121687"W�XG936]@EH1[3Z/H\7�@G>O6�:16�><E6">,+a@=687@EH�FQ9(+a@#@=936�7N[e6�+1�16"<#9(+17K)O% 9()?7#Z/)O%('�W�XG93),7KZ_+;Ah`56dRrH1%57N),'*6"<E6�'~@EH`e6C@=93643>O@=)?Z_+a@E6Z�68+-%3)?%32/>?6":16�>�WTW 6r@�F 6"6�%b@E93),7Q>O6�:16�>�+-%('d:P)O`(9(+-�\@=)�>?6":J6">�),7G@=9(6�a+-<L+-�a+~>O6�:16"> W $l@�)?%(Rr>?4('*687_�a+-<L+-�a+h<=6�>?+-@=)?H1%(7/+1%(' +hBD6"F +1'3'*)O@=)?H1%5+->Q<E6">,+a@=)?H1%577=4(RL9_+17 @E+J'3+-<=@=9PA\+#��H1<p[34(<=[eHJ7=68�rW � %36QR�+-%/)OZ_+121)?%36Q7N6�:16"<L+->P>?6":J6">,7�`56"@�FI6�6"%�@=9(6�a+-<L+-�a+�+-%('�@=9(643>}@E)OZ_+-@=6>?6":16�>�n*68+1RL9�RrHJ%J@L+-)?%3)?%32/Z�HJ<=67=6"Z_+-%\@E)?Ri)?%*BDH1<EZ_+a@=)?H1%0WXG9P4(7�n1�a+-<L+-�a+S>O6�:16">*),7�HJ%36Q)O%_+C7=6"<E)O687�H-B�>O6�:16">,7�n-`34*@pHJ%36QFQ93),RL9�95+17�<E6">,+a@=)?H1%57N93)?[@=H_7=6"Z_+-%\@E)?R�7GH1%d@=936HJ%36C9(+-%5'�+1%('�7NAP%\@E+-V�H1%d@=936H1@=936�<�WXG936�<=6 +-<E6pH1%3>?A+-<EH143%5'^7N)OV^'*)O�e6�<=6�%J@ @�AP[56870H1B(�a+-<L+-�a+Q<E6">,+a@E)OHJ%(7"W0$l@ ),7mR">O68+-<E>OA%3H1@^[5H\7=7=)O`(>O6/BDHJ<@=936�Z @EH�R"+1[*@=43<E6/@=9(6�)O%(%\4(Z�6�<E+1`3>?6/@�A\[e6�7^H-BQ7N6�Z/+1%\@=),R/<=6�>?+-f@=)?H1%57p+-Z/H1%(2C+1>O>([5H\7=7=)O`(>O6Q+1Rr@=)?H1%(7pH1<p7N@E+a@E6�7]��FQ<=)O@N@E6"%_+17�:J6"<E`(7L��+-%('/+->?>*[eHJ7E7N)?`3>?6H1`,(�6�Rk@L7#��FQ<=)O@N@E6"%s+17S%3H1Z/)?%(+->,7L�])?%�@E936#F H1<E>,'�WCgy9(+a@i@=936��a+-<L+-�a+�<E6">,+a@E)OHJ%(7Y'3H7=[568Rr)OBDA�FQ)}@E9�<E6�7=[e6�Rk@/@EHh+~:16�<=`�nI93HaF 6":16�<�n�+1<=6�7N)OV HJ<�7=H~<E6">,+a@E)OHJ%(7�H-BY%(H1Z/)}f%(+1>?7^��H1<Q:J6"<E`(+->,7E�t@E9(+a@Y[5+-<=@=),Rr)?[(+a@E6i)?%d@=936#+1Rk@E)OHJ%U7N[e6�R")}T(68'd`\Ab@=9(+-@][(+-<=@=),Rr4(>?+1<:16�<=`0W�XG9(6�7=6b+-<E6�7N43�_R")O6�%\@^BDH1<#[3<=Ha:P),'*)?%32�+UZ_+-[3[()O%32�BD<=HJZ �a+-<L+-�a+d<E6">,+a@=)?H1%57@=HU7=6"Z_+-%\@E)?R#<=6�>?+-@=)?H1%(7�WKXG9P4(7�n�@=936_�a+1<E+1�;+J7Y[(<=Ha:P),'*6^@E936/Z/+-V*)OZ#43Z|%368Rr6�7E7E+-<EA)?%*BDH1<EZ_+a@=)?H1%h<E6">,+a@=)?:16#@=HU+d:16�<=`0W � 7^+-%h6rV3+1Z�[(>O6Jn�@=936_�a+1<N@L+��a+1<E+1�;+�Z_+;AU216"@Z_+-[3[e6�'�@EH/+1216�%J@GBDHJ<QH1%36C:16�<=`0n3+-%('d6rV*[e6"<E)O6�%(Rr6�< BDH1<]+-%(H-@=9(6"<8n*6r@ER1Wgh6 95+;:16I+1>O<E6�+J'*A7N6�6"%#@=936Q'*6"T(%3)O@=)?H1%�H-Be�;+1<N@L+]�a+-<L+-�a+(Wmq]6�<=6JnaFI6G)?%*BDH1<EZ_+->?>OA'*),7=R"4(7E7�@=936Y<=6�Z/+1)O%()O%32HJ%36�7�W g~6Y7E+;Fw6�+-<E>?)O6�<�@=9(+-@t�a+-<=@E+3n-@=936Y7=FG+a@E+1%\@=<L+SHJ<�@=9(6Z/HJ7N@])O%5'*6"[e6"%('36"%\@Y[(+1<N@E)?R")O[(+1%\@G)?%U+-%U+1Rr@=)?H1%�n()?7G@E936^+17=93<L+;AJ+d�DHJ<G@=936 ����� �N� H-B+1Rr@=)?:P)}@�AJW�$&%sH-@=9(6"<^F H1<L'37�n�@=936�+1Rk@E)O:P)O@�A�<E6�7=)?'*687C)O% HJ<^7N[(<=)?%32J7iBDHJ<N@E9hBD<=HJZ|@=9(6�a+-<=@E+(W � 7=93<L+;AJ+GH1B3@=936 <E6�7=43>}@ )?7�R�+->?>O68'�a+-<EZ/+(n;)}B()O@pR"+1%^`56G'*)O�e6�<=6�%\@mBD<EH1Z �a+-<=@E+(W� :J6"<E` )O% FQ9()?RL9 +J7N9(<E+;A\+bH1BY+1Rk@E)O:P)O@�Ah+1%('s<E6�7=43>}@/R"+1% `56d'*)}��6"<E6"%\@8n ),7KR�+->?>O68'� ���!�(��� ���!����>OHPHJ7=6">?A1n ��� ���*����� ���(���;Wp{(H1<Q6"V*+1Z/[3>O6Jn*)O%d@E936CBDH1>?>OHaFQ)?%32/7N6�%\@=6"%5Rr61u

�;{>{P� { � } �;{>{ � { � {`�!� �!�7���;{ � } ��{7{,�;{>{

Page 76: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� © ���������� � ��� ��%�$&%$&�% � �� � � ��

!{P� }7� � {,�;� � }� !{ � { � {��>�.� � {,�7�;�� � �!� �>� �� �,z>z7}-�� !{P� � �7z>z7}��� !{ � { � �����7� { � {,�>�;�����

U]+1Z )?7Q@=936�a+-<=@E+(n3+-%(' U]+;:a+-%d),7G�;+1<=Z_+(W�P)?Z/)O>,+-<E>OA_�a+1<E+1%(+K�a+1<E+1�;+K)?7 @E936)?%(7�@E<=4(Z�6�%\@�W�gy)}@E9d@=936:PAJ+1[(+-<L+���H1<]+1Rr@=)?:\f)O@�A*�QH-B�@=936#�a+-<L+-%(+(n*[39(+->,+���H1<]<E6�7=43>O@L�G),7])?Z/Z�68'*),+a@=6�>OA�+1RL9()O6�:16�'�W XG9P4(7�n()?%U@=9(6+-`eHa:16_6"V3+-Z/[3>?61n�FQ)}@E9s@=936�:PAJ+-[5+-<L+�H1BG@=936d+-<E<=HaF��D) W 6JWOn�Z/H-@E)OHJ% H-BQ@=9(6b+-<E<=HaF+-%5'�7N@=<E)O�P)?%32 U]+;:a+-%5�t@E936<=687N4(>}@]H1B0@=9(6:16"<E`s�D�P)O>?> � )?7Q)?Z/Z/6�'*),+a@E6">?Ab+1RL93)?6":J6�'�W� '393)O�a+1<E+1%(+��;+1<E+1�a+/)?7G@E936^>?H*Rr4(7YH-B��a+-<=@E+/H1<Q�a+1<=Z_+3W $l@Y),7]FQ9(+-@Y7N4([3[5HJ<N@L7"n)?%�7=[(+JRr6CH1< @=)?Z/61n(@=936�a+-<=@E+#H1<G@E936�a+-<EZ_+3W� [5+1'3+1%��_�a+1<E+1�;+�),7C@=9(+-@K[(+1<N@E)?R")O[(+1%\@C)?%�+-%s+1Rr@=)?H1%s)?%\:JH1>?:P)O%32U7=6"[(+1<E+-@=)?H1%FQ93),RL9 <=6�Z_+-)?%(7K7N@E+-@=)?H1%(+1<=Aw�DH1<#)?7K@=9(6b<E6rBD6"<E6"%5Rr68�iFQ9(6"% @E936�7=6"[(+1<E+-@=)?H1%h@E+1�1687[3>,+1R"61W �]H1@=6S@=9(+-@ :P)?:;+1�*7N9(+^H1<G7N[e6�+1�16"< :P)O6�FQ[5HJ)O%\@I@=HaFG+-<L'37t+#7N6�[(+-<L+a@E)OHJ%�6":J6"%\@),7�FQ9(+-@�)?7b)OZ/[eH1<=@E+-%\@b)?% '*6"@=6"<EZ/)O%()O%32 FQ95+a@b),7b7N@E+-@=)?H1%(+1<=A�HJ<_@=9(6�<=6"BD6"<E6"%(R"6[eH1)?%J@8Wp{3HJ<Q6rV3+-Z/[3>?61n*)?%d@=936CBDHJ>O>?HaFQ)O%(2/7=6"%\@E6"%(R"61u� }$�!{ � }`|;{>{ � { ��};��� � {,�>��} � ����} �>��}>} ��� } � {,�1��} � � � };��� z,}�{ � } � � }�z>z��� }�{ � } � � }�z7z � �;�P� �7�;}��>�>}>} � � �,�;} � {,�-��} � ��

@=9(6C@=<E6"6C)?7Q@=936^+1[(+1'3+1%(+3n*+1%('b2\+-<L'*6"%d),7Q+1'*93)?�a+-<L+-%(+(W�*+1Z�[(<E+J'3+-%(+�� )?7t@=936Y`56�%36rT5R")?+1<=AJW�{3H1<t6rV3+-Z/[3>?61n\)O%/@E936]BDHJ>O>?HaFQ)?%32^7N6�%\@=6"%5Rr61uz>{��!{.��{>{ z>{��;{A� �>� �!� � �!�7�>z>{���}7��{>{ �;};� |!�,� � �A�;z {��7� � z>���;}7� � � � } ���� �;} |!�,� � � � } � { � z>��;}7� ��� �7�;} � ���;z �

@=9(6 ) 2J)O<E>>+*),7 @=9(6^7=+1Z�[(<E+J'3+-%(+(WXG936�<=6/),7+-%3H1@=936�<<=6�>?+-@=)?H1%~R�+->?>O68'~@E+1'(+-<=@=9PAJ+~�D<EH1432J93>OA�@=<L+-%(7=>?+-@=68'~+J7C[343<=f[eHJ7=68�kn(FQ93)?RL9�RrHJ%3%368Rk@E7 @�F H/:16�<=`(7G`PA_@E936 ) [343<E[5H\7N6 +*<=6�>?+-@=)?H1%�W�{3HJ<Q6rV3+-Z/[3>?61u{>{��;{2�� � } � {>{ � { |;{ � { � } �!} z>����} z>{.��{����>� �!{>{ � �>� ��{ � ��� } |;�>{,� ��� � ��{A�;} � �!} � z>����} �;�>��� �.������ �;} ��{ � �A�>���!�>�����;� ��{A�;} { |!�>{�� ��

op:J6"%i@=9(H1432J9C@E+1+J'3+1+1<N@E9PAJ+I)?7�%(H-@m+Q�a+1<E+1�;+ <E6">,+a@E)OHJ%�n�)O@0),7�)?%(Rr>?4('*68'C936"<E6�`e6�R"+14(7=6H-B @=9(6)OZ/[eH1<=@E+-%\@Q<EH1>?6S)O@Y[3>,+;A*7"W$l@7N93HJ43>,'U`56�<E6rfl6"Z/[39(+J7N)��"68'�@=9(+-@iH1@=936�<Y@E9(+-%~�a+-<=@E+3n�F 6#95+;:16^9(+J'�%3Hd'*6rf@E+1)O>?6�'s'*),7ERr4(7E7N)?H1%sHJ%s+1%PA�H-@E936"<K�;+1<E+1�a+3W�{3HJ<^Z/H1<E6�'*6r@L+-)?>?7^H1%sH-@E936"<^�a+1<E+1�;+J77=6"6CFIHJ<=�_`PA "+-43%('(+-`39(+-@N@L+�� �P9(+17N@=<E) n v ª � y �rW�/ �� ���T0�0�� �K��� �����70]� �^��� / !]2 � �_��!$&%('*),+-%>,+-%(214(+1216�7�9(+;:16p+Q<E6">,+a@E)O:J6">?AYBD<E6"6tFIHJ<E'iH1<L'*6�<�W X�+-%PASH1BP@=936 RrH1%57�@E)}@E436"%\@E7H-B^+ 7=)OZ/[3>?6�7=6"%\@=6�%(Rr6�R�+-% H*R"R"43<�)?% +-%PA HJ<E'*6�<_FQ)}@E93H143@�+a��6�Rr@=)?%32 @=9(6�21<EHJ7E7� �e� �k�8�)�;�;� ¥ �K� � ( �k� � �k� � �8¡� �e� �k�8�)�;�;� ¥ �K� � ��× ( � � � �k� � �8¡

Page 77: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �������� ���� ���� �� �� ����� ��%�� �#$\������� P$ � �

Z/6�+1%3)O%(2KH-B�@E936S7=6"%\@E6"%(R"61MPFQ9(+a@ )?7G+-�e68Rk@=68'_),7t[e6"<E9(+-[57p@E936Y6�Z�[(9(+17=)?7�n\6r@ER1Wp{3HJ<)?%(7�@L+-%(R"61n-%(H143%#21<EH143[(7 )?%�+i7=6"%\@=6�%(Rr6GR"+1%�R"H1Z/6I)?%/+-%PAH1<L'*6"< FQ)O@=93HJ4*@p+a��6�Rk@E)O%(2@=9(6_�;+1<E+1�a+b<E6">,+a@E)OHJ%(7N9()O[w�DH1<C@E936r@L+d<=6�>?+-@=)?H1%(7=93)?[(7E�S`e6r@�F 6"6�%�@E936_:16�<=`h+-%('~@=9(6%3HJ43%K2J<=HJ43[(7�Wm�P)?%(Rr6 [5H\7N)O@=)?H1%#H1< H1<L'*6"< H-B5HPR�Rr43<E<E6"%(R"6pH-B5+S%3HJ43%K2J<=HJ43[^'*HP6�7 %3H1@RrHJ%\@E+-)?%�)?%*BDHJ<=Z_+a@E)OHJ%h+1`5HJ4*@C@=936_�a+1<E+1�;+bH1<C@E936r@L+�<EH1>?6�7i)?%h+�7=)OZ/[3>?6_7N6�%\@=6"%5Rr61n+bc\43687�@E)OHJ%�R"+1%�`e6�+J7N�J6�'U<E6"2\+-<L'*)O%(2_FQ9(+a@R"+1<=<E)O687G@=9()?7i)?%*BDH1<EZ_+a@=)?H1%0WiXG936/+-%3f7=FI6�<S7=6"6"Z_7Y@=H�`56K@=9(+-@S[eHJ7N@Nfl[5H\7N)O@=)?H1%�Z_+1<=�J6"<L7]+aB @E6"<i%3H143%57#��)O% �YH1<=@=9�$&%5'*)?+1%>,+-%32J4(+-2J6�7L�CH1</7N4(<NB�+JRr6�R"+17=6b6�%('*)?%32J7#H-BS%3H143%57d��)O% �PH143@=9w$&%('*),+-% >,+-%(214(+1216�7L�H1</+�Z/)OVP@=43<E6�H1B]@=9(6b@�F H~+-@#@E)OZ/6�7�np[3>,+;A +��J6"As<EH1>?6b)?%�7=[568Rr)OBDA\)?%32s7N6�Z_+-%\@=),R<E6">,+a@=)?H1%57N93)?[(7�Wbgh6�FQ)?>O> RrH1>?>?6�Rk@E)O:J6">?A�<E6rBD6"<^@=HU@E936�[eHJ7N@^[5H\7N)O@=)?H1% Z_+-<E�16�<E7C+1%('7=43<NB�+JRr6R"+J7N6C6�%('*)?%32J7GH1Bm%3HJ43%(7]+J7G:\)?`39(+1�\@=)�H-B�%3HJ43%(7�W �IHJ%(7=)?'*6�<G@=936CBDHJ>O>?HaFQ)?%327=6"%\@=6�%(Rr687GH-B�q])?%('*)t�>WI95+-<L+a@=)�6"@]+-> W]� v ªJª v +J�N�rW� � �;{>{2��{ �����!{ � {`��� � �>� � {,�;{>{ �;}��

!{P� �!���!{ � � ��� |;}�{,� � �� !{2� |;}�{,� � �!���!{ � ��

� � �����;{ � {`���`�;{>{P� { � �>� � {,�;{>{c��};� �!���;{ � � ��� !{P� |;}�{,� � �� !{2� |;}�{,� � �!���!{ � ��

� CB �����;{ � { �;{7{P��{`��� � �>� � {,�;{>{ ��};� �!���;{ � !{2� � ��� |;}�{�� � �� �!�A�!{ � |;}�{�� � !{P� ��

� �� �;{>{2��{ ��� � ���!{ � { � �>� � {��;{>{ �;};� !{P� � ��� �;���!{ � |;}�{,� � �� �!�A�!{ � |;}�{�� � !{P� ��

$&% �SW v +1%('��SW z n XUH19(+1%�9(+J7�@=9(6i7E+-Z/6]:P)?`39(+-�\@E) ��)�W 61W?nP[(+-<L7=+1<=2HJ<t[eHJ7N@=[eHJ7=)}@E)OHJ%) �1HE+��/+-%5'y7N6�Z/+1%\@=),R�<=6�>?+-@=)?H1% FQ)}@E9y`568+a@E)O%325W�ot:16�% @E93H1432J9 @=936�[5H\7N)O@=)?H1%(7�H-B) <E+J+-Z_+,+t+1%('C) Z/HJ9(+-%(+��1HE+I+-<E6U)O%\@=6�<ERL95+-%32J6�'w)O% �SW z nQ)O@�'*HP687�%3H1@�+->O@=6�<�@=9(6<E6�7=[568Rk@=)?:16_7=6"Z_+-%\@E)?R�<E6">,+a@=)?H1%57SH1B�U]+1Z +1%(' X�H19(+1%~FQ)O@=9h@=9(6_:16"<E`�W �SW y +1%('�SW ©C7=93HaF @E9(+a@p7=6"Z_+-%\@E)?RI<=6�>?+-@=)?H1%#H-B UY+-Z ),7�)O%\@E6"<LRL9(+-%32J6�'FQ)O@=9�@E9(+a@�H-B XUH195+-%`PA^)?%J@E6"<LRL9(+-%(21)?%32Y@E936")?<p:P)?`39(+-�\@E)�W��PHi@=936Q:P)?`39(+1�J@E)?7t+-<E6 R"<=4(R")?+1>*)O%_'*6"@=6�<=Z/)?%3)O%(2@=9(6�7=6"Z_+-%\@E)?R<EH1>?6�7�W�U]6">,+a@=)?:16#[5H\7N)O@=)?H1%�H-B�@=9(6#%3HJZ/)O%(+1>m7=6"6�Z/7Y@=H�`56�%3H1@S:16�<=A)?Z�[eH1<=@E+1%\@ BDHJ<]'*6r@E6"<EZ/)O%3)?%32�7=6"Z_+-%\@E)?Ri<E6">,+a@=)?H1%57"Wq]HaF 6":J6"<8nP@=93)?%32\7]+-<E6%3H-@i+->?F +;A*7Q7N@=<L+-)?219\@NBDHJ<=FG+-<L'b+1%('�@=936BDHJ>O>?HaFQ)?%32_%36"68'@=H/`e6^+1R�RrH14(%J@E6�'bBDH1<8uv W � '3)}��6"<E6"%\@�:P)O`395+-�\@=)3R�+-%�`56Q4(7=6�'KBDH1<�@E936Q7=+1Z/6G7=6"Z_+1%J@E)?R <E6">,+a@E)OHJ%KFQ)O@=9/+21)?:16"%K:16"<E`^)?%#+i'*)O�e6�<=6�%J@�7=6"%\@=6�%(Rr6JW {(H1< 6rV3+-Z/[3>?61na)?%^@E936Qq])?%('*)37=6"%\@=6�%(Rr687ZKW v @=H Z#W ©5n +1>}@E93H14(219 U]+-Z 9(+17i@E936b7E+-Z/6�7=6"Z_+-%\@=),R�<=6�>?+-@=)?H1%sFQ)O@=9s6�+-@�D%(+1Z�6�>OAJn(@E936K+1216"%\@YH1B�6�+a@k�kn�+�'*)O�e6�<=6�%\@S:P)O`(9(+-�\@=)m)?7Y4(7=6�'U68+1RL9d@=)?Z/6����mn%361n5�1H(ne7N6KFQ93)?RL9U<E6"[(<=687N6�%J@Q%3HJZ/)O%(+-@=)?:16Jn(6"<E2J+-@=)?:16Jn(+1R�Rr4(7E+a@E)O:J61n(+1`3>?+-@=)?:16Jn<=687N[e6�Rr@=)?:16">?A3�kW

Page 78: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ���������� � ��� ��%�$&%$&�% � �� � � ��

� � ��{>{P��{ � �!{>z>{ ��� �>�!{>{,�;{7{c�;};� ;{P� � �7����� � ��� }>{,� � � �� !{P�n}�{�� � �7�;} � �7����� ��

� � ��{>{P��{ � } � �;{>z>{ �>�!{>{,�;{7{ ;{P� �A� } � �,����� {���}� !{P�s{,�>}��7�;} � �7����� �

� B ��{>{P��{ ��� � �!{>z>{ ���!{>{ � {>{ � {��!{7{ ;{P� � ��� � �7����� }�{,� �!{�� � �;�� !{P� �!{���;��}�{����7�;} � �7����� ��

��� ��{>{P��{ � } � �;{>z>{ � {A���>� �>�!{>{,�;{7{ � {,�;{7{ ;{P� ��� } � �,����� � ��� }>{,� �7���!z�� !{P� �7�A�!z�� � ��� }�{,���,�;} � �7�!��� ��

z WY�*+-Z/6/:P)O`395+-�\@=)pR�+-%�`e6_4(7=6�'~FQ)}@E9h@=936_7E+-Z/6/:16"<E`�BDHJ<C@�FIH�'*)O�e6�<=6�%\@K7N6"fZ/+1%\@=),R�<E6">,+a@E)OHJ%(7�Ww$&%yoYW v +-%5'�oYW z nt@E936�7=+1Z/6d:P)?`39(+1�J@E)^� @E9(+a@b),7�n) %36[+[(+-<L7=+1<=2P�Q),74(7=6�'~BDH1<VXUH19(+1%h+1%('~@=936_�J6"AJn0FQ936�<=68+17i@=9(6")?<^7N6�Z/+1%\@=),R/<=6"f>?+-@=)?H1%�@=H ) HJ[56�% +e+1<=6^c\43)O@=6�'*)O�e6�<=6�%J@8WY�P)?Z�)?>,+-<E>OA�BDH1<') 7=6[+5)O%�oYW y +-%('UoYW � n��o]W v n3oYW z +-%5'doYW ©_+1<=6C7=+1Z/6C+J7 WiW v n,WSW z n,WiW y n*<E6�7=[568Rk@E)O:J6">?A*�rW

� � � ���!{ � { � } ��{>{>z>{>{ ���!�7z>{>{ �;���!{ � �A� } z7���.� � � } � }��� �!���!{ � � � } � }-���7�;} z>�>�.� ��

� � � � { �,{>{�|��>� � } �;{>{>z7{>{`���!�7z>{>{ �,��� � �;}7� ��� } z>���.� � � } � }-��� ��� � �;}7� � � } � }-� �7�;}�z>���.� �

� B �,{>{�|��>� � } �;{>{>z7{>{ ���7�!z>{ � {,�;{7{ �;}7� |�� z>���.� � � } � }-��� �;} z>�>�.� � � } � }-����� � }�� � };�A��}-�;z,����|>���7�;} �;}7� ��

� �� ��{>{>z>{>{ ���>�!z7{ � {,�;{>{ z7���.� � � } � }-��� �;} z>�>�.� � � } � }-� ��

� ��`|;{��>�,} � } �;{>{7z>{>{ ���>�!z>{ � {��;{>{ �.���7z�� |�� z>���P� � � } � }���� �;} z>�>�.� �!{ � � � } � }���� � � � �>} � �!�7� � {>z>z,� |����7�;} �A�!�7z�� �� ��� �;} �A���7z����!{ � {�|;z7}��;��� � } � �7��} z>���.���

Page 79: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ��� � �%$&%�$&�% ������� �� � �

�/ N� � �^�U!"�U!��^� ���90]�K� ���+-%()O%3),+-%~21<L+-Z/Z_+-<C),7C[(+-<=@=),Rr43>,+-<E>?A�7N4()}@E6�'�@=H�BD<E6"6/FIHJ<E'~H1<L'*6�<i>,+-%(214(+1216�7�W�$l@Z_+-�J6�7]457N6#H-Bp:P)O`(9(+-�\@=)�)?%*BDH1<EZ_+a@E)OHJ%�BDH1<iZ/+1[3[3)?%32�@EH�7=6"Z_+-%\@E)?RK<=6�>?+-@=)?H1%(7�n5+1%('4(7=6�7C[eHJ7=)}@E)OHJ%~)?%*BDHJ<=Z_+a@E)OHJ%�HJ%3>OA~7N68RrH1%5'3+-<E)O>?A1W � 7C@E936/$&%('*),+-%h>?+1%3214(+121687Y9(+;:J6�D<E6">,+a@E)O:J6">?A3�GBD<E6"6�FIHJ<E'UHJ<E'36"<C+-%('�:\)?`39(+1�\@=) n�@=936�A�+-<E6K6"Z/)?%36"%\@E>OA�7=43)O@=6�'�@=Hd`e6'*687=R"<=)?`568'h`\A~��+-%3)?%3),+-%h21<L+-Z/Z_+-<8W�XG936���+1%3)?%3)?+1%�BD<L+-Z/6�FIHJ<=�UFG+17CHJ<=)?21)?%(+->?>?A'*687N)?21%368'�Z/H1<E6^@E9(+-%�@�FIHdZ/)O>?>?6"%3%3),+d+-21HbBDH1<iFQ<=)O@=)?%32�+b2J<E+1Z/Z/+1<YH1B �*+-%57N�P<E)}@8M)O@]9(+17G`e6"6�%�+J'3+-[3@=6�'�`PAb4(7 @EH�'*6�+1>�FQ)}@E9�Z�H*'*6�<=%d$&%('*),+-%�>,+-%32J4(+-2J6�7�W��< ;<@? ACG�B,G��#G H����&GPQ,D�� Ro�V3+1Z�[(>O6�7=6"%\@=6�%(Rr687�)?% q])?%('*)SBD<=HJZ @E936�[(<=6�:\)?H1457�7N68Rk@E)OHJ% �D)?% �Sn�Z +-%('yo �)?%('*),R"+a@E6p@E9(+a@ @=936�<=6I)?7 %3Hi7�@E<E+1)O2J9\@NBDH1<EFG+-<L'YZ_+-[([3)O%(2]BD<EH1Z :P)O`395+-�\@=)J@=HC7N6�Z_+-%\@=),R<E6">,+a@=)?H1%�`56"@�FI6�6"%�%3H143%d21<EH14([(7I+1%('�:16"<E`(7�W XG9(6i�J6"A/@EH/+1<=<E)?:\)?%32�+a@Q+-%�+-%(7=FI6�<),7 @=H_),'*6"%\@=)OBDA�+1[3[3<EH1[3<E),+a@=6i<E6">,+a@=)?H1%57"nP) W 6JWOn3�a+1<E+1�;+#<E6">,+a@=)?H1%57"WXG936GZ/HJ7N@�)OZ/[eH1<=@E+-%\@�)O%57N)?219\@�<=6�2J+1<E'*)?%32Y@=936G212J�a+-<L+-�a+afl:P)O`395+-�\@=)JZ/+1[3[3)?%32C)?7@=95+a@�)}@p'*6�[56�%('37 H1%K@=936 :16�<=`�+-%(')O@E7 @E6"%(7=6G+17=[568Rk@�Z�H*'3+1>O)O@�A_��X � X��m>,+-`e6"> W XG9(6Z_+-[3[()O%32�),7I<E6"[(<=687N6�%J@E6�'_`PA/@�F H#7N@=<E4(Rk@E43<E6�7�u�'36rB�+-4(>}@G�a+-<L+-�a+KRL9(+1<N@G+-%('��a+-<L+-�a+RL9(+1<N@/@=<L+-%57�BDHJ<=Z_+a@E)OHJ%�W XG936�'*6"B�+-43>O@��a+-<L+-�a+sRL9(+-<=@/BDH1<�+s:J6"<E`�HJ<�+ Rr>,+17E7/H-B:16�<=`57p21)?:1687p@E936YZ_+1[3[3)?%32^BDHJ<t@E936iX � X >?+1`56�>��\%(HaFQ%�+17I`(+17=)?R1W�$l@ 7=[568Rr)OT(6�7I@=9(6:P)O`(9(+-�\@=)�[e6"<EZ/)}@=@=68'�BDHJ<C@=936�+1[3[3>?)?R�+-`3>?6/�a+-<L+-�a+b<E6">,+a@E)OHJ%(7^BDHJ<C@=936_%3HJ43%(7C6"@ER-WFQ936�%�@=9(6K:16�<=`�9(+17]@=936�`(+17=),RKX � X >,+-`e6"> WCXG936K`(+J7N),RKX � X >?+1`56�> RL9(HJ7=6"%UBDHJ<q])?%('*)0)?7�) @E+J+ 936")S+3+-%5'b<EH1432J93>?A/R"H1<E<=687N[eH1%5'37I@=H�[3<=687N6�%\@G)?%('*6"T(%3)O@=6i@=6�%(7=61W � %PAH-@E936"< X � X >,+-`e6">PRrHJ43>?'^9(+;:16p`e6"6�%KRL93H\7N6�%^+17m`(+17=)?RpFQ)}@E93H14*@�+-%PAi[3<EH1`3>?6"Z�WmXG9(6X � X >,+-`e6">,70+1<=6p[(43<=6�>OAC7=A\%\@L+1Rk@E)?Rp)O%^%5+a@=4(<=6t+1%('R"+1%`56 '*6r@E6"<EZ/)O%368'`PAS>?HPH1�P)?%32+a@C@E936_:16�<=`�BDH1<EZ +-%('�@=9(6/+J7=7=H*Rr),+a@E6�'�+14*V*)O>?),+-<EAU:16"<E`(7�n�6r@LR-W_{3HJ<iH1@=936�<^X � X>,+-`e6">,7"n(@=936�<=6^+1<=6�a+-<L+-�a+/RL9(+1<N@Q@E<E+1%(7�BDHJ<=Z_+-@=)?H1%d<=43>?6�7�WIXG9P4(7�n3BDHJ<Y+/21)?:16�%�:16"<E`FQ)O@=9�7=H1Z/6KX � X >,+-`e6">0)?%�+_7=6"%\@=6�%(Rr6Jn5+-[([3<=HJ[3<E)?+-@=6C�a+-<L+-�a+afl:P)O`395+-�\@=)�Z_+-[([3)O%(2R"+1%�`e6CH1`*@L+-)?%36�'�4(7=)O%(2�)O@E7Q'36rB�+-4(>}@]�a+-<L+-�a+#RL9(+-<=@]+-%('�@=936C@E<E+1%(7�BDHJ<=Z_+-@=)?H1%�<E43>?6'*6�[56�%('*)?%32_H1%d)}@L7]X � X >?+1`56�>�WXG936C'*6rB�+143>O@G�a+1<E+1�;+#RL9(+-<=@ BDH1< @=93<E6"6iH-Bm@=936C�a+-<L+-�a+J7t),7 21)?:16"%�)O%�{ )O2J43<E6 � W y WXG93),7Y6"V*[3>?+1)O%57]@E936#:P)?`39(+1�J@E)?7S)?%~7=6"%\@=6�%(Rr687 �SW v @EH �SW ©(W � 7�U]+-Z ),7Y@=936/+-2J6"%\@)?% �SW v +-%(' �SW z nG+-%(' XUHJ9(+-%w)?% �SW y +-%(' �SW ©(nG+-%(' @=9(6�+-2J6"%\@�),7/@E936UZ/HJ7N@)?%('*6"[e6"%5'*6"%\@/BDH1<#@=936U+JRk@=)?H1% �D`e6�+a@k�knI)}@_),7K6"VP[(<=687=7=6�' `PA Z/6�+1%(7�H-B]@E936d�;+1<N@L+�a+-<L+-�a+3MP+-%5'/@=936S<=6�Z_+-)?%3)O%(2^%3H1Z/)?%(+->e`PA/�;+1<=Z_+�a+1<E+1�;+(W {(H1<I@=936S�a+-<=@E+�a+-<L+-�a+(n��:P)O`395+-�\@=)p),7^457N68'sFQ)}@E9 @E+J+ 936") X � X >,+-`e6">t)?% �SW v @=H �SW ©�+17^6rV*[3>,+-)?%36�'s)?%{ )O2J43<E6 � W y W{ )O2J43<E6 � W ©_21)?:16�7Y7NHJZ�6C@E<E+1%(7NBDH1<EZ/+-@=)?H1%d<=4(>O687QBDH1<]@=936�'*6rB�+143>}@SZ/+1[3[3)?%32_BDHJ<q])?%('*) W�$l@p6rV*[3>,+-)?%(7m@=936Q:P)?`39(+1�J@E)*)O%_7=6"%\@=6�%(Rr687TZKW v @=H�Z#W ©���+17E7N43Z/)?%32i@=9(+-@3U]+-Z),7C@=936_�a+1<N@L+d+1%('~[39(+->,+s� BD<E43)O@L�C),7C@=9(6_�;+1<=Z_+\�kW � 76"V*[3>?+1)O%(6�'~`\Ah{ )O2J43<=6 � W ©5n��Gd� �E�(£E� � �L£L� � ¥�¤ �E� ���k�-� � � ¥ ( ¥ � × ���.� ��¢ ¤�¥ �?�k� � � ¥ � ¢ # �k¢ �����)�1� ¤ � � ¥ ( ¥ �1�1�(�k� � � ¥ ( � � � ���'� ¤ � �� ¥ � ¢+* � � � �L¤�¤ � ¥ � ¢1� &0� ¤�¤1� �L£k¥t�L¤�¤ ( �)� ����¢ ¤�¥�£L� � �L£L� � ¥N¤ �E� ���k�1�'*

Page 80: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� # ���������� � ��� ��%�$&%$&�% � �� � � ��

� ��� ���!� % ��� ) ����� � � � ��� � � � �"+-<=@E+ � Z/+1%('3+-@=H1<EA"+-<EZ/+ �JH#HJ<�� Z/+1%('3+-@=H1<EA"+-<L+-%(+ 7=6iHJ<]'*:a+1+1<E+J+ HJ[*@=)?H1%5+->{m)?214(<=6 � W y uTZS6rB�+143>}@]�a+1<E+1�;+�RL9(+1<N@

�a+-<=@E+ @L+-�1687�) %36[+�:\)?`39(+1�\@=)1)?% Z#W z `e6�R�+-4(7=6pH1B*X � X�>,+-`e6">E) A\+1+E+1�D)?%@=9(6pZ_+-)?%:16"<E`21<EH14([��P9(+J+;AJ+1+\�kn ) �JHE+*)?% ZKW y `e6�R"+14(7=6iH1B�X � X >,+-`e6">�%5+1+ [(+ ZS+J+��D)?%U�\95+1+-%5+1+[(+ ZS+J+J�kn\+-%(' )�7=6[+1)?%*Z#W ©K`568R"+-457N6]H1B�X � X >?+1`56�>(A\+1+ 2J+;A\+1+/�D)?%_�P9(+1+;A\+1+i2J+;A\+1+�kW�� �P6"6 � [([56�%('*)OV�BDH1<i93HaF ��+-%()O%3),+-%��i<E+1Z�Z_+1<Y9(+1%('*>?6�7i7N)?Z/)O>,+-<C[3936�%3H1Z/6�%(+)?%U�3+-%(7=�P<=)O@�W��

�!��� � ��� � � �*� ���*�� �(��� �� � ��� ) ����� ��� �(� �!�(���-�AJ+J+ %36%(+1+ [(+[Zi+1+ �1HAJ+J+ 2J+;AJ+J+ 7=6H1<Q'*:a+1+1<E+J+���+-%('d�a+-<=@E+#),7QH1[*@E)OHJ%(+-> �{ )?2143<E6 � W ©(u�Xm<E+1%(7�BDHJ<=Z_+-@=)?H1%b<E43>?6�7

XG936^'*6"B�+-43>O@YZ_+-[([3)O%(2�+-%('d@E<E+1%(7�BDHJ<=Z_+-@=)?H1%b<E43>?6�7]+1>?7=H_6rV*[3>,+-)?%Uo]W v @=HboYW � W�]H1@=6I@=9(+-@ `PAHJ43< '36rT(%3)O@=)?H1%#H-B57=FG+a@E+1%\@=<L+QH1< )O%5'*6"[e6"%('36"%\@�n[X�H19(+1%K),70@E936 �;+1<N@L+)?%�oYW v n;R�+1+1`3)O)���H1<��16�A*�0)?%#o]W z n-+1%('@L+1+1>?+J+K�DHJ<�>OH*RL�3��)?%#oYW y n-o]W ©i+1%('KoYW � W � B @=6"<@=9()?7G@E936:P)O`(9(+-�\@=),7GH-B��a+-<=@E+#)O%UoYW v @=H_oYW � +-<E6+17G6"VP[(>?+1)O%368'b)?%U{ )O2J43<=6 � W ©5W � �$&%_216�%36"<L+-> na@E936]@E<E+1%(7�BDHJ<=Z_+-@=)?H1%(7�+-�e68Rk@I%(H-@tHJ%3>OAK@=936S:P)O`395+-�\@=)5H-B��a+-<=@E+C`34*@+->,7=H^@=95+a@QH-B0H1@=936�<G�;+1<E+1�a+17�WmXG936�Ab+->,7NH*) '36">?6r@=6 +*�a+-<L+-�a+<EH1>?6�7 +a@G@=)?Z/6�7�nP@=9(+-@ ),7"n@=9(6 ) '*6�>O6"@=68' +3�a+-<L+-�a+#<=HJ>O687Q'*H/%3H-@]H*R"R"43<G)O%d@E936^7N6�%\@=6"%5Rr61W$l@�),7d)OZ/[eH1<=@E+1%J@�@=Hw<=6"f 6�Z/[39(+17=)��"6U@E9(+a@d@=936�@=<L+-%(7NBDH1<EZ_+a@E)OHJ% '*6"[e6"%('(7�HJ%X � X >?+1`56�>*FQ93)?RL9#)?7�[(43<=6�>OA^7=AP%\@E+1Rr@=),R-n-+1%('K%(H-@�H1%#@=6"%57N6Jn1+17=[568Rk@�+-%('KZ/HP'(+->?)}@�AFQ93),RL9_+-<E6]7N6�Z/+1%\@=),R-W�XG936]X � X >?+1`56�>(R"+1%/`56Y'36r@=6�<=Z/)?%36�'�BDHJ<pq])?%('*)e+-%('/H1@=936�<$&%('*),+-%d>,+-%32J4(+-2J6�7p`PAb7=AP%\@E+1Rr@=),R]BDHJ<=Z_7 H-B0@=936C:16�<=`d+-%('�)O@E7Q+-43VP)?>?)?+1<=)?6�7IFQ)}@E93H143@@=9(6#%36�6�'�@EHb<E6rBD6�<]@=H�+-%PA�7N6�Z_+-%\@=),RK+J7N[e6�Rr@E7�WSXG936�7N[e6�R")}T5R�+a@E)OHJ%UBDH1<iH1`*@L+-)?%3)?%32X � X >?+1`56�>?7G),7Q2J)O:J6"%d`\A�+KT5%3)}@E6^7�@L+a@E6Z/+JRL93)?%36+17Q'*687=R"<=)?`568'b)?% �I9(+-[0W�©(WXG936 ��+-%3)?%3),+-%i@=936�H1<EACH14*@E>O)?%36�'K+-`eHa:16]�D) W 61W?na�;+1<E+1�a+]RL9(+-<=@E7m+-%('C�a+1<E+1�;+YRL9(+-<=@@=<L+-%57�BDHJ<=Z_+a@E)OHJ%(7L�GR"+-%U`e6�4(7N68'd@=H�216"%(6"<L+a@=6��DH1<i+-%(+1>OA ��68� @E936#7=6"%\@=6�%(Rr687]2J)O:J6"%+-`eHa:16p+J7�F 6p9(+;:J6t7N6�6"%�Wmq]HaF 6":16�<�n�@=9(6"<E6t+-<E6t+1'('*)}@E)OHJ%(+->\RrHJ%(7�@E<E+1)O%\@L7�@=9(+-@mF H143>,''*),7=+1>O>?HaFy@E936CBDH1>?>OHaFQ)?%32_7=6"%\@=6�%(Rr687 @=H/`562J6"%36�<E+-@=68'�nPBDH1<Q6"V*+1Z/[3>O6a�=�au��� �0� ¥ �l�;�k��� ¥ �L� �;� × ��� �L¤ � � �K¢ ¥ �1� ¥ ����� � � ¥ � ¥ � ��¥ �8� ¥ ��� ×]� � ¥ ¢ �/� � ¥ � ( ¥=�L£k¥ � �1�����; ��� � �L£ � � � &0�;� ¤�¥3×]� (-( ���; I�O� � × � ¥k×]� � � ��� ¤�¥ � ¥�¤\� � � � ¥p£L� � �L£L� ¤�¥ � ¥�¤ *�&�� s� � ¡ ¢ ¥ �O�k� ¥p� � ¥ � ��¥ �;� ¥ ���-�;��� �E� ¥ � � � �E� � � �����;� �m�  k���� � ¥ � ��¥ �;� ¥ *

Page 81: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� � � � P$>�P� � � �1� $>�P� � ª� � � z>{�;{A�!} � } �;{>{2��{ � }�z>{��!{A���>� ��� � ���;{>{A|!{��!�>�

|!��� �A� }� !{P� ��� } � ���;z � ��� |!�>�A� � { � }� � � �;}� !{2� �7�;} |;�,� � { � } { |!�>�.� �;� �,�;} � ����z ��

� � � z>{��!{A�!} � } z>{��;{A� �>� �!� � ����{>{�|!{ � �!�>�>z>{ �!�>� |!��� �A� } � ����z � ��� |!�>�.� � z>��;}7� � { � }� � � �;} |!��� � { � }�{ |!�>�A� { � z>���;}7� �;� �,�;} � �A�;z ��

XG936RrHJ%(7N@=<L+-)?%J@L7G+-<E6i2J)O:J6"%d`56�>OHaFuv W]ot+1RL9hZ_+-%('(+a@=HJ<=A~�a+-<L+-�a+d)O%s@E936��a+-<L+-�a+URL9(+1<N@BDHJ<^6�+JRL9h:J6"<E`s21<EH143[�nm)?76rV*[3<E6�7E7N68' ��� ��� � ��� ��� � �"Wh��$&% H-@=9(6"<F H1<L'37"n +�21)?:16�%~Z_+-%5'3+a@EH1<EA��a+-<L+-�a+216"%(6"<L+a@=687�H1%3>?AiH1%36p%(H143%2J<=HJ43[CFQ)}@E9@=936I7N[e6�R")}T(68':P)O`(9(+-�\@=)J)O%)O@E7m�a+-<L+-�a+RL9(+-<=@ 4(%3>O)?�16)?%U{ W v W �z W]ot+1RL9UHJ[*@=)?H1%5+->0�a+1<E+1�;+�)O%�@=936#�;+1<E+1�a+�RL9(+-<=@YBDHJ<S68+1RL9U:J6"<E`U21<EH143[�ne),7S6"VPf[3<=687=7=6�' �(� � �(��� ��� � �rWy W]ot+1RL9�7NHJ43<LRr6GFIHJ<E'#21<EH14([�7E+a@E)?7NT(6�7t7NHJZ�6G�a+-<L+-�a+i<E6">,+a@=)?H1%�FQ)O@=9_7NHJZ/6Q:16"<E`�DH1<�7=H1Z/6tH1@=936�< <E6">,+a@E)OHJ%5�kWm$&%KH1@=936�<mF H1<L'37�n�@E936"<E6G7N93HJ43>,'%3Hi43%(RrHJ%3%368Rk@=68'7NHJ43<ER"6tF H1<L'K2J<=HJ43[K)?%/+i7=6"%\@E6"%(R"61n-H1@=936�<=FQ),7N6Jn;@=936]7=6"%\@E6"%(R"6I`e6�R"H1Z/6�7�`(+J'+17 )O%U{ W z W"+-<L+-�a+ RL9(+1<N@L7�+-<E6�`(+J7N68' H1% @E936 ),'*68+ H-B�+J+-�a+1+1%3�*7N9(+J+ +-%(' AJH12JAJ+a@L+1+Z/6"%\@=)?H1%(6�'y68+-<E>O)?6"<�)?% �I9(+1[�W z W � �a+-<L+-�a+ RL9(+1<N@bBDH1<�+ :16�<=`y6"VP[(<=687=7=6�7_)O@E7+1+1�a+1+-%(�P7=9(+J+17iH1<K'36"Z_+-%('(7"n�+-%(' 7=[e6�Rr)OT(687@=9(6�:P)O`395+-�\@=),7@E9(+a@KZ#4(7N@K`56b4(7N68'�D) W 61W?n3A1HJ21AJ+-@E+J+J��FQ)O@=9�F H1<L'b2J<=HJ43[(7I@=95+a@Y7E+a@=),7NBDA_@=936^'36"Z_+-%('(7"WXG936i7=+1Z�6Y)?'*68+17 R"+1%�`56i4(7=6�'/@EHK9(+1%('*>?6Y%3HJ43%*f&+1' (�68Rk@E)O:J6�7�nJ%3HJ43%*fl%3H14(%_<=6�>?+-f@=)?H1%57"n*:J6"<E`*f :J6"<E`b<E6">,+a@E)OHJ%(7 6r@ER1WXmHs7=93HaFj@=9(+-@�@=936�+1`5Ha:J61nt@=93HJ43219 %368+a@�nG),7_%3H1@�(�4(7�@d+-% +1'w93H*R�Z/6�RL9(+-f%3),7NZ @=95+a@#6"V*[3>?+1)O%57@=9(6�)?7=H1>,+a@E6�'s[39(6"%3HJZ�6�%(+�H-BY7=6"Z_+1%J@E)?R/<EH1>?6�7^Z/+1[3[3)?%32U@EH:P)O`(9(+-�\@=),7�n*FI6^'*),7ERr4(7E7 @�FIH�H-@E936"<Q[(936"%3HJZ/6"%(+(up+1Rk@E)O:J6rfl[(+17E7=)O:J6S+-%5'�R"H1%\@=<EH1> W

�/ �� � � ��! �"0 � ��8#8�! �"0�]H#7N6�[(+-<L+a@E6I@E936"HJ<=A#)?7t%36"68'*6�'�@EH^6rV*[3>,+-)?%�+1Rr@=)?:16"f [(+J7=7=)?:16�7�W � Rk@=)?:16S+-%('�[(+J7=7=)O:J6@=4(<=%~H14*@i@=H�`56/7N[e6�R")?+1>�R"+17=6�7YH-BIR"6"<=@E+1)O%�X � X >?+1`56�>?7�n�%(+1Z�6�>OAJne@=93H\7N6#4(7N68'U@EHZ_+-<E�b+1Rr@=)?:16+-%5'b[(+J7=7=)?:161W � 2J+-)?%�RrH1%57N),'*6"< @E936CBDH1>?>OHaFQ)?%32/6rV3+1Z�[(>O6C)?%�qY)O%5'*)�W� CB��;{>{P� { �����;{ � { ��� � �>� � {��;{>{ �;};� � {����;� � }%�

!{P� �!���;{ � � ��� |;}�{,� � � ��} � � !{P� |;}�{,� � �;���!{ � �

� ����;{>{P� {�� � {>{,��{>{ �����;{ � {`��� � �>� � {>{ � {,�;{7{ � � { �>� � � } � !{P� |�� �!���;{ � � ��� |;}�{,�>} � �!{ �� �!���;{ � �!{ � |�}�{,��} � |��� !{P� ��

Page 82: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ���������� � ��� ��%�$&%$&�% � �� � � ��

��6"<E`s)O% { W ©�9(+17KX � Xx>,+-`e6"> +17CA\+1+ 2\+;AJ+1+(W �IH1%(7=6�c\436�%J@E>OAJn�@E936�:P)O`(9(+-�\@=))�'*:a+1+-<L+1+E+�BDHJ<��a+1<N@L+ � UY+-Z��KBDH1>?>OHaF]7KBD<=HJZ @=936d@=<L+-%57�BDHJ<=Z_+a@E)OHJ%�+->?<=68+1'*As2J)O:J6"%6�+1<=>?)?6"<G)O%U{ )?2143<E6 � W ©(W

�/ �� ���#������� �� Z_+:(�HJ<�7N43[([5HJ<N@_BDHJ<_@=936�@E936"HJ<=AwRrHJZ�687�BD<=HJZxR"H1Z/[3>?6rVw7=6"%\@E6"%(R"6�7�nt@E9(+a@�),7"n7=6"%\@=6�%(Rr687�RrHJ%J@L+-)?%3)?%32sZ�HJ<=6d@E9(+-%yHJ%36U:16�<=`w21<EH143[0W g~6�T(<E7N@�)?%J@E<=H*'*45Rr6�@=9(6[3<EH1`3>?6"Z +-%('�@=936�% '*6�7ERr<E)O`e6/93HaF @E936/@=9(6"H1<EA�[3<EHa:P)?'36�7C+-%s+-%(7=F 6"<8W �IHJ%(7N),'*6�<@=9(6CBDH1>?>OHaFQ)?%32_7N6�%\@=6"%5Rr6�7G)?%�q])?%('*) u� � �;{>{2��{ � �!{>z7{ ���!{7{A��{,�;{ �����;{ � { ��� |>�!z>{>{��;{>{ �;};�

!{P� � �7���A� �!{ � � ���;� }>{,��} � �!���;{ � � ��� �7{>z>z � � ���� { � � ��� }�{���} � � �,����� � ;{P� �7{>z7z � �!���!{ � ��

� � �;{>{2��{ � } � �!{>z>{ ��{>{ � {A��{,�;{ ���!{>{��;{>{ !{P� � } � �7����� �!{ � � ���;� �A�>� {,��}� !{2� {,��} �;{ � � ��� �.�����7�;} � �7����� ��

� CB � �!{7z>{ ��{7{ � { � }`�!} z����>} � � { � } �7{>{A�>�>� z����;{7{ � �7�!��� �;� � �A��� � �!} � z��A��}��;} ��� } � � � � }��;�>�A���� ���A��� � �,����� � �;} �;�>�A�n{ � � � � } ��

$&% ��W v n U]+-Z�),7�@E936S�a+1<N@L+H-B�`eH-@E9_@=936S:16�<=`(7�u �\95+1+���6�+a@k�p+1%('_`343>,+1+b��R"+1>O> �kWq]HaF 6":J6"<8n�)}@H*R"R"43<L7CH1%3>?A�H1%5Rr61W/XG936/[3<EH1`3>?6"Z )?7i@EHd),'*6�%J@E)}BDA~FQ93),RL9~:J6"<E`~FQ)?>O>RrHJ%\@=<EH1>0)O@E7i:P)?`39(+-�\@E)�W$&% ��W z n��a+1<N@L+*U]+1Z +1%('U@E936��;+1<=Z_+b[39(+->,+��DBD<=4()}@k�Y`eH-@E9+-<E67N95+-<E6�'�`PAb@=936C@�F H/:16"<E`(7 �a+1+JXm+���R"4*@L�]+-%('��P9(+1+��D68+a@k�kW�$&% ��W y n*@=9(6�;+1<N@L+) 4(7=+E+��D936;� )?7Q7=9(+1<=68'�`e6r@�F 6"6"%d@E936C@�FIH�:16�<=`57"n*+-%5' )�R"+J+-�P434 +����\%()}BD6;�I@=936�a+-<EZ_+�a+-<L+-�a+#H-B�) >?)O)S+0�D@E+-�J68�I),7G@=936�a+1<E+1%(+���)O%57�@E<=43Z/6�%J@L+-> � �a+-<L+-�a+KH1B�) �a+1+1X +,+���Rr4*@k�kW

XG936iH1`(7=6"<E:a+a@E)OHJ%_@=9(+-@G@=936CZ_+a@E<=)OV�H1<GZ_+-)?%b:J6"<E`b<L+a@=9(6"<I@=9(+1%b@E936C)O%\@=6�<=Z/6"f'*),+a@E6:16"<E`�R"H1%\@=<EH1>,7I@=936:P)?`39(+1�J@E)�H-Bm@=936^7=9(+1<=68'b%3HJZ/)O%(+1>�)?7 @E<=4(6)O%d@=9(6C+1`5Ha:J67=6"%\@=6�%(Rr687"WtXG9(6C@=936�H1<EA�FI6FQ)?>?>�H14*@E>O)?%36C@EH_6">,+-`eH1<L+a@=6CHJ%�@E93),7G@=936�Z/6^FQ)O>?>�9(+;:J6@�F HU[(+-<=@E7�WbXG936_T5<E7N@^[(+-<=@^21)?:1687i@=936b�;+1<E+1�a+b@EHU:P)O`395+-�\@=)pZ_+1[3[3)?%32�+17C457N4(+1>�n@=9(6^7N68RrH1%5'b[(+1<N@Q),'*6"%\@E)}T(687]7=9(+-<E6�'b�;+1<E+1�a+17�W��<�� <@? ACG�B,G��#G Q ��� D���NG ��Q,D� G�LL�D ��

XG936�)?%\@=6�<=Z/6�'3)?+-@=6�:J6"<E`(7C9(+;:16/@E936")?<#X � X >?+1`56�>?7�(�457�@�>O)?�16_H1@=936�<K:16�<=`57"W�{3HJ<6rV3+1Z�[(>O6Jn��;+1<E+b)?7S@E936�X � Xx>,+-`e6">�H-Bt�P9(+J+���6�+a@k�S)O% ��W v +-%('���W z n�+-%('�%(+1+b)?7@=9(6�X � X >,+-`e6"> H-B]�a+J+1X +���R"4*@L�^)O% ��W y W � 7�4(7=4(+-> n @=93687N6dX � X >,+-`e6">,7^9(+;:J6@=<L+-%57�BDHJ<=Z_+a@E)OHJ%�<E43>?6�7 @E9(+a@YHJ[56�<E+-@=6+-%5'�Z�H*'*)OBDA�@E936K'*6"B�+-43>O@Y�a+-<L+-�a+/RL9(+1<N@8Wp$&%[(+1<N@E)?R"43>?+1<�n(@=936�7N4(2121687�@E6�'d@E<E+1%(7�BDHJ<=Z_+-@=)?H1%�<=4(>O687]BDHJ<]@=9(6^@�F H�>?+1`56�>?7i+-<E6^2J)O:J6"%)?%�{m)?214(<=6 � W � W�XG936_@=<L+-%57�BDHJ<=Z_+a@E)OHJ%�<E43>?6_FQ)}@E9 �;+1<E+d)?%�{ )O2J43<=6 � W � 7E+;A*7i@=9(+-@

Page 83: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� ��� ��%V� ���� � v

� � � � ��� � � �*� ���*�� �(��� �(��� � ��a+-<L+ "+1<N@L+UZK457�@K%(H-@#`e6b[(<=687N6�%J@8W "+-<EZ_+�)?7HJ[*@=)?H1%5+-> W%(+J+ "+1<N@L+#+1%('d�a+-<EZ/+�+-<E6CH1[*@E)OHJ%(+-> W@E+J+ 9P4(+J+ "+1<N@L+#+1%('d�a+-<EZ/+�+-<E6CH1[*@E)OHJ%(+-> W{ )O2J43<E6 � W � uTXUH1<E6i@=<L+-%(7NBDH1<EZ_+a@=)?H1%�<=4(>O687� BDH1<]R"H1Z/[3>?6rV�7=6"%\@E6"%(R"6�7L�

�a+-<=@E+KH-B�@E936S:J6"<E`�FQ)O@=9�X � X >?+1`56�>��;+1<E+^ZK4(7N@ %(H-@G`56i[3<E6�7=6"%\@I)?%�@E936i7=6"%\@E6"%(R"6+-%5'�@E936�a+-<EZ/+�),7QH1[3@=)?H1%(+1>O>?A_[3<E6�7=6"%\@�WW A^@E936�7=6]<E43>O687"n1@=936S)O%\@E6"<EZ�68'*),+a@=6Q:J6"<E`/�\95+1+_�D68+a@k��)?% ��W v +1%('��a+1+1X +_��R"4*@L�)?% ��W z '*HY%(H-@m95+;:16Y��)O%('36"[e6"%('*6�%\@L�m�a+-<=@E+Q�a+-<L+-�a+Q[(<=687N6�%J@m)O%K@=936 7N6�%J@E6"%(R"61WPU]+-Z),7p@E936S�a+1<N@L+^H-B�@E936iZ/+1)O%b:16"<E`�W�[39(+1>?+�� BD<E43)O@L�t)?7t@=936i�a+-<EZ_+^H-B��P9(+J+^)?% ��W v `34*@%3H1@IH-B��a+1+JXm+^)O% ��W z W�$&%_@E936Y>,+a@=@=6"<8n\[39(+->,+),7�@E936Y�a+-<EZ_+H-B�@E936YZ_+-)?%�:J6"<E`�W � >O>@=9(6�7=6]+-<E6 +JR"RrHJZ/Z�H*'3+-@=68'^`PA^@E936]+-`eHa:16I@=<L+-%(7NBDH1<EZ_+a@E)OHJ%^<=4(>O6GBDHJ<�) �a+-<L+,+?W � XG9(6Z/H*'*)}T56"<=f Z/H*'*)OT(6�'/@E<=6�6i7N@=<E4(Rr@=43<E6�7t[3<=H*'*45Rr6�'b+-<E6S7=93HaFQ%�)?%�{ )O2J43<E6 � W � ��)O2J%3H1<E6'*H1@N@=68'd>O)?%36�7L�kW

��<�� <>= ACG�B,G��#G���NG�BED��

�]HaF FI6C2J)O:J6i<E43>?6�7 BDHJ<QH1`*@L+-)?%3)O%(2#@E936^7=9(+-<E6�'��a+-<L+-�a+17�W"+-<=@E+CH1B�@=936i)O%\@E6"<EZ�68'*),+a@=6Y:16"<E`_�P9(+1+^)O% ��W v +1%(' ��W z R"+1%�`56SH1`*@L+-)?%36�'/`PA@=9(6^7N9(+1<=)?%32�<=4(>O6K� v +OW

������� ���� "+1<N@L+^H1Bm+�:16"<E`�FQ)O@=9�X � X >,+-`e6">�) �a+-<L+,+\)?7I@E9367=+1Z�6C+17I@E936C�;+1<N@L+H-B0@E936Z_+-)?%�:16"<E`�WXG936Q7=9(+-<E)O%(2Y<E43>O6\��7L�0+1<=6G+-[([3>O)?6�'#+aB @E6"<�@=9(6I@E6"%\@E+-@=)?:16 �a+-<L+-�a+Y+J7=7=)O2J%3Z/6"%\@m),7�Ha:16�<4(7=)O%(2��a+1<E+1�;+K@=H_:P)?`39(+1�J@E)�Z_+-[3[3)?%325W

{3HJ<p�a+-<EZ_+H-B�)?%J@E6"<EZ/6�'*),+a@E6]:16�<=`/FQ)O@=9bX � X >,+-`e6">e�a+-<L+3n-F 6]9(+;:J6Q@=9(6Y7N95+-<=f)?%32/<=43>?6K� z +OW������� ���� $lBe+-%K)?%\@=6�<=Z/6�'3)?+-@=6 :16"<E`^FQ)O@=9K@=936GX � Xj>,+-`e6"> ) �a+-<L+,+�@E+-�J6�7 +]�a+-<EZ_+��+17�7=[e6�Rr)OT(68'#)?%_)O@E7p'*6"B�+-43>O@p�a+-<L+-�a+iRL9(+-<=@L� FQ93)?>?6Q%3H1%36Q95+17�`e6"6"%/HJ`*@E+1)O%368'4(7N)?%32]�a+1<E+1�;+G:P)?`39(+1�J@E)1Z_+-[([3)O%(2(n8@=936�%^)O@m7N95+-<E6�7�)O@E7m�a+-<EZ/+GFQ)O@=9^@=936I�;+1<N@L+H1< @=936�a+1<=Z_+�H-Bm@=936Z_+-)?%�:16�<=`�W

�.����� � � � � � � � ���J�O�k� × � ¤ �E� ¥ � � � ¥ �k� �� k��� �L¤ � � ¤�¥m� � �E� � � � �;� × ��� �L¤ � � � � £L� � �L£L� � ¥N¤ �E� ���k�1���;� (&0� � � � &�� � ¥ � ¢-� #8� � ¥ � � � ¥\×]� ��� � ¥ ��¢ &0� ¤�¤ �N�k� � � � ¤ � � � ����¢;� �L£r� � *

Page 84: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� z ���������� � ��� ��%�$&%$&�% � �� � � ��

<L+1+-Z_+ Z/HJ9(+-%(+

<L+1+-Z_+ [39(+1>?+��DBD<=43)O@L�� �����Qy � � � W � � y #\z n z # W © �1z �a©J�r� v � W z ª v �Pn � � �a+-<=@E+� �:���+y � � � W � � y #\z n z # W © �1z �;©J�"� v � � W � �:��y �Pn � ��

� v © � W��-ª � #\z n z # W © �1z �;©\�r� v,y W �Jz[���;y n � � �;+1<N@L+� v © � W �;ª � #Jz n z # W © �-z �8©P�r��ª z W # © z:�3v n � � �a+1<=Z_+� v © � W �;ª � #Jz n z # W © �Jz �;©\�r� zJz[� W �[� � # n � �

<L+1+-Z_+ [(9(+->,+�� BD<E43)}@k�

<E+J+-Z_+ [39(+1>?+� �[���Qy � �;y W � # � �%# n z # W © �Jz �;©\�r� v � W z ª v �Pn � � �a+-<=@E+� �����+y � �;y W � # � � # n z # W © �1z �a©J�r��ª z W � � © z1z n � �

� v © z W v �aª � �Pn z # W © �1z �;©\�r� v,y W �Jz[���;y n � � �;+1<N@L+� v © z W v �-ª � �\n z # W © �-z �8©P�r� v �Jz W�� v � �;y n � � �a+-<EZ_+� v © z W v �aª � �*n z # W © �-z �;©\�r� z;y*v W z � v � �\n � �

:a+-9(+���9368� R"+J+-�P434s�D�P%3)OBD68�

<L+1+-Z_+ [395+->,+(� BD<E43)O@L� R�+1+1�\4(40�D�P%3)OBD68�� �����Qy � v8zJz W z # � �;y n z # W © �1z �;©J�"� v � W z ª v �*n � � �a+1<N@L+� �[���Qy � v;z1z W z # � ��y n z # W © �1z �a©J�r� v � � W � ���;y �\n � � � ���

� zJz1z W # � # � � n z # W © �1z �a©J�r� z�� W � ª1©-©Jª3n � � �;+1<N@L+� zJz1z W # � # � � n z # W © �1z �a©J�r� v8z*v W z # �[�3v n � � �a+-<EZ_+� z1z-z W # � #[� � n z # W © �1z �a©J�r� yJz!y W © � � � # n � �

{ )O2J43<E6 � W � uOXUH*'*)}T56"<=f Z/H*'*)OT(6�'y<E6">,+a@E)OHJ%(7/BDHJ<�7=6"%\@=6�%(Rr687 ��W v n ��W z +-%(' ��W y n<E6�7=[568Rk@=)?:16�>OAJWQ���P9(+1<=68'b�a+1<E+1�;+J7G7N93HaFQ%d`PAb'*H1@N@=68'd>O)?%36�7�W��

Page 85: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� ��� ��%V� ���� � y

gy)O@=9^@E936G+-`eHa:16p<E43>?6�7�n;@=936G7N95+-<E6�'C�a+-<L+-�a+17�BDH1< ��W v n ��W z +-%(' ��W y +-<E6I7=93HaFQ%)?%�{ )?2143<E6 � W � `\A�'*H-@=@=6�'d>?)O%(6�7�W�$&%b@E936CBDH1>?>OHaFQ)?%32/6rV3+1Z�[(>O6Jn� � ���!{,�;�>��;{A�!{,�;{ �;{>{2��{ � } � �!{>z>{ ���!{>{��;{>{

�!{ � � ���;� |!�A� � ��� !{P� ��� } � �7����� {,��}� !{P�n{,��} � �,�������!{ � � ��� |!�A� � ��� ��� ��

�a+-<=@E+�+-%5'��a+-<EZ_+dH-BG�\95+-<E)O),'3+h�D`343A3�+1<=6#@=9(6�7=+1Z�6�+J7i@=936_�a+1<N@L+�+1%('h�;+1<=Z_+(n<E6�7=[568Rk@=)?:16�>OAJn�H-B �P9(+1+s�D68+a@k�kW�{ )O2J43<E6 � W��b7=93HaF]7i@=936_<E6">,+a@E)OHJ%(7=93)O[57S[()?Rr@=H1<E),+->?>OAJW

<L+1+-Z_+ [39(+->,+�� BD<E43)O@L�

<E+J+-Z_+ [(9(+->,+� �[���Qy ��©Jª3W � � © y�y n z # W © �Jz �8©P�r� v,y W �Jz��[�;y n � � �a+1<N@L+� �[���Qy �D©\ª3W � � © y�y n z # W © �-z �8©\�"� # �PW � � © z3v n � �

�P9(+1<=)?)?'� v7y # W # © �!y ©(n z # W © �1z �a©J�r� v,y W �1z �:�!y n � � �a+-<=@E+� v7y # W # © �!y ©5n z # W © �1z �a©J�r� v �Jz W�� v � ��y n � � �a+-<EZ_+� v,y # W # © �;y ©(n z # W © �1z �a©J�r� z1z �\W ª y #!y ©(n � �

{m)?214(<=6 � W �Pu���+1<E7=6i7N@=<E4(Rr@=43<E6iBDH1<]7=6"%\@=6�%(Rr6q^W v

�P)?Z/)O>,+-<E>OAJnP@=936^7=9(+1<=)?%32�<=43>?6iBDH1<G@L+1+ 9P4(+J+#R�+-%d`56^7N@E+-@=68'd+J7]� y +?W������� � �� � %)O%\@E6"<EZ�68'*),+a@=6t:16"<E`CFQ)}@E9^X � X�>?+1`56�>,) @E+J+ 9P4(+1+E+"7=9(+-<E6�7�)O@E70�;+1<N@L+FQ)}@E9�@E936�a+-<=@E+#H-B @=936Z_+1)O%d:16�<=`�W� 7]6rV3+-Z/[3>?61n3R"H1%(7=)?'36"<8u� � � ���.�!{>{,�!�>� � }c|>�!{7{ � {,��} �7�;} � ��}7�;{ �!����}����;{>{

�>� � �>}7� ��� } �>���,z7} � �7� �>� � ��� z��,� � � �!� � {���� �;} �>� � ��},� � {� { z��7� � �7���7z7}��7� �>� � ��� ��

XG936 +-`eHa:16�),7m+1ZK`3)?2143HJ4(7�`e6r@�F 6"6�%^FQ936r@E936"<0@=936I9P43%\@=6"<mF +J7�<E43%3%3)?%32]HJ<�@E936t>?)OHJ%FG+17G<E43%3%3)?%32(W �YHaFn*�;+1<E+1�a+K:P)?`39(+-�\@E)�Z_+-[3[3)?%32/AP)O6�>?'(7G@=936CBDHJ>O>?HaFQ)?%32#<E6">,+a@E)OHJ%�u��}����;{ � � }>}%���{,�7�;{�~ � �!�.��{>{,�;�>� � �>� � ��}7� ���{,�.��{�~ � ��}7�;{ � z>�7� � �

|>�!{>{ � { � �7� � �� � ��{,�;{A�!{���}�z>{,�;�7� � }�� � ��} �>� }�� }�� � z��7�>���;z,�

XG936Y+1`5Ha:J6Q+-<E6]7N93HaFQ%/[3),Rk@EH1<E)?+1>O>?AK)?%�{ )O2J43<E6 � W # �D)?21%3HJ<=6]'*H1@N@E6�'/>?)O%3687�BDHJ<p%3HaFY�kW

Page 86: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�;© ���������� � ��� ��%�$&%$&�% � �� � � ��

7=93)O�a+J+-<E)O)��D9P43%\@E6"<k� 7=936�<E+d�D>?)OHJ%5�

7N9()O�a+1+1<=)?)� �[���Qy � v$# W z;y �3v � n z # W © �Jz �;©\�r� v # W z�y �3v � n � � �a+-<=@E+

`395+1+-2\+���<=4(%5�� v;z ª(W �(v ª # � n z # W © �1z �;©\�r� y �\W ª+� z;y n � � �a+-<=@E+� v8z ª*W �3v ª # � n z # W © �Jz �;©J�"� v ©Jª*W y � � n � � �;+1<=Z_+� v8z ª(W �*v ª # � n z # W © �1z �a©J�r� z © v W � �;y � � n � �

{m)?214(<=6 � W # u���+1<E7=6i7N@=<E4(Rr@=43<E6iBDH1<]7=6"%\@=6�%(Rr6q^W z

W A UQ43>?6� y +?n\F 6SR�+-%�)?'*6�%\@=)OBDA_@=936C7=9(+-<E6�'_�a+1<E+1�;+J7pH1B0<=4(%�W�q]6"<E61nP@E936i�;+1<N@L+H-B�<E43%�F H14(>?'�`56C@E9369P43%\@=6�<�WpXG93),7G),7]7N9(HaFQ%b`PA�'*H1@N@E6�'d>O)?%3687G)O%U{ )O2J43<E6 � W # WXG936�<=6�),70+1%3H-@E936"<�[5+-<L7N6�BDHJ<�@=9(6t7N6�%\@=6"%5Rr6tR"H1<E<=687N[eH1%('3)O%32 @EH]:16�<=`*fl%3HJ43%CZ�H*'Pf)OT5R"+-@=)?H1%^FQ)O@=9^:J6"<E`(+->E) `(9(+1+12J+a@E6�9P436[+P�D<E43%3%3)?%32P��Z/H*'*)OBDA\)?%32S%3H143% ) 7=936"<L+,+\�D>?)OHJ%5�kW"+-<L+-�a+Y<=6�>?+-@=)?H1%(7mH-B�'*6"�P9(+/��7=6"6;� +17 H1`*@L+-)?%36�'#`PA�a+-<L+-�a+Y:P)?`39(+1�J@E)PZ/+1[3[3)?%32+-<E6@=9(6/7E+-Z/6JW WI43@7=)?%(Rr6�`39(+J+-2J+bZ/HP'3)}T(687C7N936�<E+�n�@=9(6��a+1<N@L+�H-BI`39(+1+12J+b)?7C7=936"<L+`PA�<E43>O6K�*©�2J)O:J6"%d`56�>OHaFW�XG936[5+-<L7N6C7�@E<=45Rk@=4(<=6C),7]7N9(HaFQ%�)?%U{m)?214(<=6 � W ª3W������� � $lBG+b:J6"<E`�FQ)O@=9sX � X >,+-`e6">�@L+1+ 9P4(+J+bZ/H*'*)OT(6�7+�%3H14(%�n�@=9(6"%~@=9(+-@%3H143%d),7Q)}@L7G�a+-<=@E+3W

��}����!{ � � }>}%�

�!{,�>�;{ �!{,�A��{

� �!�.��{>{,�;�>� � �;},�;{� �>� � ��}7� � � z��,� � �

�� �;��� � ���!� � �7�7{,�!�7� ��

|>�!{7{ � { � �7� � ��� ��{,�>��{�

� �;},�;{

{ )O2J43<=6 � W ª(u � %3H-@E936"<Y[(+-<L7N6C7N@=<E4(Rk@E43<=6iBDHJ<]7N6�%J@E6"%(R"6^q^W z

Page 87: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� ��� ��%V� ���� � �

XG936h[(+-<=@�H1B^[(+-<L7=6�7�@E<=45Rk@=4(<=6h7N93HaFQ% `\Ay7=H1>?)?' >O)?%36�7d),7bHJ`*@E+1)O%(6�'y`PAy�a+-<L+-�a+:P)O`(9(+-�\@=)�Z_+-[([3)O%(2(WpXG936i[(+-<=@Q7N93HaFQ%�)O%�'*H1@N@=68'b>?)?%36�7�D@=936C�a+-<=@E+KH-Bm`(9(+1+12J+J�p)?7H1`3@E+-)?%368'b`PA U]43>O6^�P©5Wgy936�%�@E936"<E6+-<E6CZ�HJ<=6i@E9(+-%�H1%(6i)?%\@=6�<=Z/6�'3)?+-@=6:16�<=`d21<EH14([(7 )O%U+/7N6�%\@=6"%5Rr61n@=9(6"<E6#),7C+�%36�6�'�@=Hd216"%(6"<L+->?)���6@=936/<E43>?6�7S21)?:16"%�6�+-<E>?)O6�<�WXmH�HJ`*@E+1)O%�@=936/7N95+-<E6�'�a+-<L+-�a+CH-B0+1%�)?%J@E6"<EZ/6�'*),+a@E6]:16�<=`�n\)?%(7�@E6�+J'_H-B�2J6r@N@E)O%(2^)}@ BD<EH1Z @=936iZ_+-)?%_:16"<E`_F 6ZK457�@^HJ`*@E+1)O%h)}@BD<EH1Z @=936_:J6"<E`���+1Rk@E)OHJ%5�iZ/H*'*)}T56�'h`PA�@=9(6_)O%\@=6�<=Z/68'*)?+-@=6/:16�<=`0WXG936�Z/H*'*)OT(6�'s:J6"<E` RrH14(>?'h`e6_@=936bZ/+1)O% :J6"<E`sH1<K+1%3H-@E936"<^)?%\@=6�<=Z/6�'3)?+-@=6_:16�<=`0WXG936%36�F 2J6"%36�<E+1>O)��"68'*UQ43>?6�7Y+-<E6� v n(� z +-%5'�� y W������� �� "+1<N@L+�H1B )?%\@=6�<=Z/6�'3)?+-@=6_:16�<=`sFQ)O@=9�X � X >,+-`e6"> ) �a+-<L+,+�),7@E936b7E+-Z/6+17I@=936�a+1<N@L+#H1Bm@E936:16�<=`�Z/HP'3)}T(68'd`\Ab@=936)?%\@=6�<=Z/6�'3)?+-@=6C:16�<=`�W������� �� $lB�+-%/)?%J@E6"<EZ/6�'*),+a@E6Q:16"<E`/FQ)}@E9/@=936]X � X >,+-`e6"> ) �a+1<E+E+;@E+-�J6�7�+C�a+-<EZ_+��+17�7=[e6�Rr)OT(68'#)?%_)O@E7p'*6"B�+-43>O@p�a+-<L+-�a+iRL9(+-<=@L� FQ93)?>?6Q%3H1%36Q95+17�`e6"6"%/HJ`*@E+1)O%368'4(7N)?%32]�a+1<E+1�;+G:P)?`39(+1�J@E)1Z_+-[([3)O%(2(n8@=936�%^)O@m7N95+-<E6�7�)O@E7m�a+-<EZ/+GFQ)O@=9^@=936I�;+1<N@L+H1< @=936�a+1<=Z_+�H-Bm@=936:J6"<E`�Z/H*'*)OT(6�'d`PA_@=9(6)O%\@=6�<=Z/68'*)?+-@=6:J6"<E`�W������� � � %#)?%\@=6"<EZ/6�'*),+a@E6I:J6"<E`KFQ)O@=9/X � X�>?+1`56�> ) @E+J+ 9P4(+J+,+a7N95+-<E6�7m)}@L7��;+1<N@L+FQ)}@E9�@E936�a+-<=@E+#H-B @=936:J6"<E`�Z/H*'*)OT(6�'d`PA_@E936)O%\@E6"<EZ�68'*),+a@=6C:J6"<E`�W

� 7Q+1%�)O>?>O457�@E<E+-@=)?H1%�n3R"H1%(7=)?'36"< @=936CBDHJ>O>?HaFQ)?%32_7N6�%J@E6"%(R"6iBD<=HJZjq])?%('*) u� CB��;{>{P� { � } �!{7{,�7�!{ � } �A���>�,zA��{,�;{ �!}�z>{7{ ���;{>{,��}��>��}

!{P� �A� } �!{ � � ����� } �!{ � � �>�;��� }>}>z7}-� |!{ � { � { }�{��!� ���

|!{ � ��{,�;{ �����>}����!{>{ ��� � �;}7� � ��� � {�� !{P� � {� { � � � �!}7��}�{,�!� �>� { |!{ � { � { �!{ � � ����� }7}�z7}-� ��������7����� � �!{ � � � ��

XG936�+-`eHa:16^),7Y+1ZK`3)?2143HJ4(7Y+J7Q@EHbFQ93H�[56�6">?6�'�+1%('�+a@E6@=9(6#`(+1%(+-%5+3W�"+-<L+-�a+�@EH:P)O`(9(+-�\@=)�Z_+1[3[3)?%32_[3<EHP'34(Rr687 @=936CBDHJ>O>?HaFQ)O%(2#<E6">,+a@E)OHJ%(7"u��}����;{ � � }>}%���{,�7�;{�~x�;{7{P��{��{,�.��{�~�|!{ � �;{,�;{ � ��� � �!},� �

�A���>�,z>{ � � }>}>z ���{,��{ � {�~��;{>{,�7�!{ � �!{ � �%�

���!{>{ � }�{,� ���{,�.��{�~&�!}>z>{>{ � |;{ � { � { �

XG936i+-`eHa:16Q<E6">,+a@=)?H1%57p+-<E6Y7=93HaFQ%_)O%�7NHJ>O),'/>O)?%3687p)?%b{ )O2J43<=6 � W v � W �]HaFnJH1%b+1[3[3>?A\f)?%32�@=936�a+-<L+-�a+�7N95+-<E)O%32/<E43>?6iF 6C216"@Q@=936CBDHJ>O>?HaFQ)O%(2KBDHJ43<]+->O@=6�<=%(+-@=)?:16C[(+1<E7=6�7�uv W � 7E7N43Z/6GRL93)?)O>,+K��[56�6"> �0Z/H*'*)OT(6�7 �P9(+J+K�D68+a@k�kW �$# WIA U]43>O6Q� v na�;+1<N@L+]H1B5RL93)?)O>,+)?7 @E936Q7=+1Z�6Q+J7 @=936G�a+-<=@E+SH-B��P9(+1+(W �P)?Z/)O>,+-<E>OAJn-�a+-<EZ_+YH1BeRL93)?)O>,+i)?7 @E936]7E+-Z/6� + � �l�;��� ¤ �8¡ � � � � � ¥ � � ¤ � ¢ ¥�¤ � £L� � �8¡�# &0�;���l� ×Q¥=� �-� � � �E� � � ( � ¥ � ¥ � ¥ � � � ¥�� � � ���k� � �E× ���;� ,;¥ �'*�����-� # � � �;��� ¤ �8¡¢× ��;� ,a¥ �m� £ � �k�8¡�×Q¥N� �1� � � �E�m� � ¥p� � � ���k�^� �l�;��� ¤ �8¡ � ( ¥�¥�¤ ! & � � ( ¥ ���O�k� ×Q¥ �]¢ ¥ �O�k� ¥

( ¥ ���O�k� × ���;  � � ¥p� � � ���k�K� £ � �k�8¡ �O¥N�E�2! *

Page 88: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ���������� � ��� ��%�$&%$&�% � �� � � ��

+17i@=9(6_�;+1<=Z_+�H1B �P9(+J+3n�`PA U]43>O6b� z W �YHaFn�@=9(6"<E6�+-<E6#@�F H�+->O@=6�<=%5+a@=)?:1687BDH1<QFQ9(+-@G�P9(+J+�Z�H*'*)OT(687"W��+J�b�P9(+1+��D6�+-@L�YZ/HP'3)}T(687]@E936�:16"<E`�'*6��\95+���7=6"6;�kW W A9U]43>O6/� y n��a+-<=@E+�H-B�P9(+1+�),7 @=936^7E+-Z/6+17 @E936�a+-<=@E+�H-B�'*6"�P9(+U��7N6�68�rWpXG936"<E6rBDHJ<=6Ju

���!{>{ � }�{,� ���{,�7�;{�~x�;{7{P��{

�A���>�,z>{ � � }>}>z ���{,�7�;{�~x�;{7{P��{��{,�.��{�~&�!}>z>{>{ � |!{ � { � { �

{ )O2J43<E6 � W v � ��+J�G7=93HaF]7 @=9(6[(+-<L7N6C7N@=<E4(Rk@E43<=6JW�D`5���P9(+1+ ��6�+-@L�CZ/H*'*)OT(6�7^@=936�%(H143% `(+1%('3+1<E+s�DZ/HJ%3�16�A*�rW W AOUQ43>?6��P©(n`(+1%('3+-<L+#)?7G@E936�a+-<=@E+#H-B��P9(+1+��D68+a@k�kW

���!{>{ � }�{,� ���{,�7�;{�~�|!{ � �;{,�;{ � ��� � �!},� �

�A���>�,z>{ � � }7}�z ���{,�7�;{�~�|!{ � �;{,�;{ � ��� � �!},� ���{,�.��{�~&�!}>z>{>{ � |!{ � { � { �

{ )O2J43<E6 � W v � ��`5�Q7=93HaF]7I@=936[5+-<L7N67N@=<E4(Rk@E43<=6JWz W � 7E7N43Z/6YRL9()O)?>?+_��[56�6"> ��Z/H*'*)OT(6�7 '*6"�P9(+_��7N6�68�rW�W A UQ43>?6i� v n1�a+-<=@E+CH1B0RL93)?)O>,+)?7S7=+1Z�6^+J7]�a+-<=@E+/H1Bp'*6"�P9(+(n5%(+1Z/6">?Ab<L+1+-Z_+(W�W A UQ43>?6�� z n3@=9(6K�a+-<EZ_+/H-BRL93)O)?>,+��D[e6"6�>,�#),7^@E936d7E+-Z/6d+17^�a+1<=Z_+�H1BY'*6"�P9(+���7=6"6;�kn�%(+1Z�6�>OAJnp`(+1%('3+-<L+�DZ/H1%3�J6"A3�kW�XG93),7d)?7d7N6�Z_+-%\@=),R"+1>O>?Ay+-%3HJZ/+1>OHJ4(7b+J7bZ/HJ%3�16�AP7�R"+1%3%3H-@�`e6[56�6">?6�'�W�$lBKF H1<E>?' �P%3HaFQ>?6�'3216�7=93HaF]7b@=93),7�@=H `e6s+-% +1%3H1Z_+->?A1n]BD43<N@E936"<[3<=H*R"6�7E7N)?%32YF H14(>?'#`56Q`(>OH*RL�168'�WmqYHaFI6�:16�<�n;)OB�7=4(RL9�FIHJ<=>,'^�P%3HaFQ>?6�'*2J6I),7�%3H1@+;:;+1)O>,+-`(>O6�@=H�@E936�7=AP7N@=6�Z�nm)O@KF H143>,'~R"H1%\@=)?%P436_[3<EH*Rr6�7E7=)O%325WbXG936�<=6_F H143>,'`56i@�F H#+->O@=6�<=%5+a@=)?:1687"W�"+1<N@L+^H-Bm�\95+1+�R"+-%�9(+;:16S@�F H#[eHJ7E7N)?`3>?6iRL9(H1),Rr6�7I>?)O�J6)O% v ��+J�G+-%5' v �D`5�rW

��R����P9(+1+���6�+a@k� Z/HP'3)}T(687Q'*6"�P9(+���7N6�68�kWpXG9(6"<E6rBDH1<E61n*�a+1<N@L+KH1B �P9(+J+K),7G@=9(67E+-Z/6+17 @=9(6�;+1<N@L+�H-B '36"�P9(+3W]� �P6"6^{ )?2143<E6 � W v � ��R��rW ����!{>{ � }�{,� �

��{��>�;{�~ �;{7{P��{�A���>�,z>{ � � }>}>z �

��{��>�;{�~ �;{7{P��{��{��A��{�~x|!{ � �;{,�;{

XG936�a+-<=@E+J7 9(+-[3[e6"%d@EH_`56C@E936^7=+1Z/6C+J7G)O% v ��+J�rW��'(���P9(+1+U��6�+-@L� Z/H*'*)}T56�7]`5+-%('3+1<E+d�DZ/HJ%3�16�A*�rn(FQ93),RL9�`PAb<E43>O6K�*©_Z/+1�1687)O@Q@=936�a+-<=@E+�H1Bm�P9(+1+(WQ���P6�6^{m)?214(<=6 � W v � ��'(�rW �

���!{>{ � }�{,� ���{��>�;{�~x|!{ � �;{,�;{ � ��� � �;}7� �

Page 89: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� �n��! � � � �� � �

�A���>�,z>{ � � }7}�z ���{��>�;{�~ �;{7{P��{��{��A��{�~x|!{ � �;{,�;{

�/ �� ���!� � �� �

$&%d@=93),7YRL95+-[*@E6"<8n*FI69(+;:J6'*)?7ERr457=7=6�'�@=9(6>O)?%3214()?7N@=),R^+17=[e6�Rk@]H1B���+1%3)?%3)?+1%bBD<L+-Z/6"fF H1<E��+17Q+-[([3>O)?6�'�@EH�Z/H*'*6�<=%d$&%('*),+-%�>,+-%32J4(+-2J6�7�W

<L+1+-Z_+ `5+-%('3+1<E+5�DZ/H1%(�16"A3�

<L+1+1Z_+ �16�>?+J+(��`(+-%(+1%(+J�

<E+J+-Z_+ �16�>?+J+ 9(+J+a@E9(+��D9(+1%('(�� # ©5W � � � # # n z # W © �1z �;©\�"� v7y W �\z����!y n � � �a+-<=@E+� # ©(W � � � # # n z # W © �1z �a©

� v � �PW © # ª � ª(n z # W © �1z �;©J�"� v7y W �Jz��[�;y n � � �a+-<=@E+� v � �\W © # ª � ª3n z # W © �-z �8©\�"� # � W �!y �Jz1z n � � �� v � �PW © # ª � ª*n z # W © �-z

� z!y # W � �;y[� ª3n z # W © �1z �;©\�r� v,y W �Jz[���;y n � � �;+1<N@L+� z!y # W �[�!y�� ª*n z # W © �-z �8©P�r��ª-©3W v$# ª �!y n � � �;+1<=Z_+� z!y # W �[�;y[� ª*n z # W © �Jz �;©\�r� y(v$# W �3v � � # n � �

��+J�

Page 90: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� # ���������� � ��� ��%�$&%$&�% � �� � � ��

<L+1+-Z_+

`(+1%('3+-<L+(��Z/H1%3�J6"A3� �16">,+1+���`(+-%(+1%(+J�

`5+-%('3+1<E+ �J6">,+1+ 9(+J+a@E9(+��D9(+1%('(�� v �\z W ª+� � ª � n � � W ª � � � �"� v �*W��aª v � z n � � �a+-<=@E+� v �1z W ª � � ª � n � � W ª � ��� �r�

� z3v � W ��y �!y �Pn � � W ª � �[� �r� y # W © # �\z-z n � � �a+-<=@E+� z3v � W �;y �!y �\n � � W ª � �[� �"� v �Jz W v �*v � ©3n � � �;+1<=Z_+� z*v � W �;y �;y �\n � � W ª � ��� �"� y!y[� W y��3v �-ª*n � �

� z3v � W ��y �!y%# n � � W ª � �[� �r� z*v � W �;y �;y # n � � :\fl%dZ/H*'*)OB

`(+1%('3+-<L+d�DZ/H1%3�J6"A3�� z �*v W � �[� ª �Pn � � W ª � �[� �r� v7y W �1z[���!y n � � �a+1<N@L+� z[�3v W �[��� ª �Pn � � W ª � ��� �"� z # � W � �[� � �Pn � �

'*6"�P9

�D`e�

{ )?2143<E6 � W v � u � >}@E6"<E%(+a@E)O:J6i[5+-<L7N687��+J� +1%('s�D`5�IBDHJ<G@=936^7=6"%\@=6�%(Rr6qKW y

Page 91: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� �n��! � � � �� �-ª

<L+1+-Z_+ `5+-%('3+1<E+

<E+J+-Z_+ �J6">,+1+d�D`(+1%(+-%(+\�� � � W y �*v © �*n � � W ª � � � �"� v,y W �\z����;y n � � �a+-<=@E+� �[� W y �Pv ©+�Pn � � W ª � ��� �"� #%# W z:�Jz #%# n � � �a+-<EZ_+

�P9(+1+��D68+a@k�

<L+1+1Z_+ `(+-%5'3+-<L+��DZ/H1%3�J6"A3� 95+1+a@E9(+��D9(+1%('(�� v1v7y W �3v ª �!y n � � W ª � � � �"� v,y W �\z����;y n � � �a+-<=@E+� vJv,y W �3v ª �!y n � � W ª �[�[� �r��ª � W #[�[�

� z © # W � � � ªJª3n � � W ª � �[� �r� v7y W �1z[���!y n � � �a+1<N@L+� z © # W � � � ª-ª3n � � W ª � ��� �"� � y W ©\ª-© �Jz n � � �;+1<=Z_+� z © # W � � � ª1ª3n � � W ª � ��� �r� v$#�� W � ª � © �Pn � �r� z © # W � � � ª-ª(n � � W ª � ��� �r� y%#1z

��R8�

<L+-Z_+

`(+1%('3+-<L+��DZ/H1%(�16"A3� �16">,+1+���`(+-%(+1%(+J�� # � W # �-ª yJz n � � W ª � �[� �"�D© � W v �-z # # n � � �a+1<N@L+� # � W # �;ª y1z n � � W ª � ��� �r� v © v W z�� #[� # n � � �a+-<EZ_+

�\95+1+d�D6�+-@L�� # � W # �-ª y!y n � � W ª � �[� �"� # � W # �;ª y;y n � � :\fl%�Z/H*'*)OB

`(+-%('(+-<L+(�DZ/HJ%3�16�A*�

<E+J+-Z_+ `5+-%('3+1<E+d�DZ/HJ%3�16�A*� 9(+J+a@=95+���9(+-%('5�� vJv,y W �3v ª ��y n � � W ª � �[� �r� v7y W �1z[���!y n � � �a+1<N@L+� v1v,y W �*v ª ��y n � � W ª � ��� �"��ª � W # ��� � # n �

� z © � W � � � � � n � � W ª � �[� �r� vJv W v�z[���!y n � � �a+1<�@E+� z © � W � � � � � n � � W ª � ��� �"� v,y �PW � #1z3v ©(n � � �a+1<=Z_+� z © � W � � � � � n � � W ª �[� � �r� y � � W �!y;y # � n � �

��'5�

{ )O2J43<=6 � W v � u � >O@=6�<=%(+-@=)?:16C[(+1<E7=6�7C��R8�G+-%('h��'5� BDH1<G@E936^7N6�%\@=6"%5Rr6q^W y

Page 92: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

#[� ���������� � ��� ��%�$&%$&�% � �� � � ��

XG936CH1<E)?21)?%(+->�BD<L+-Z/6"F H1<E�/F +J7Q+-[3[(>O)?6�'�@=H��*+1%(7=�\<E)O@�M3936�<=6i@E936^RrHJ%(Rr6�[*@E7Q+1%('7=[3)O<E)O@IH-B0@=936SBD<E+1Z/6"F H1<E�K9(+;:J6]`56�6"%�4(7N68'�)?%�6rV*[3>,+-)?%3)?%32K:a+1<=)?H14(7t>?+1%32145+-216Y[3936rf%3HJZ�6�%(+3W� JB�Q,N�� B H�� G��D��

$�'*68+17�[3<E6�7=6"%\@=68'�)O% @E93)?7~RL9(+-[3@=6"<U95+;:16s6":JH1>?:16�' Ha:16�<�@=936 A16�+1<E7�nC6�+1<=>?)O6�<[3<E6�7=6"%\@=68' )?%�W 9(+-%P43Z_+a@E)i� v ª # ªJ�rnTWI95+-<L+a@=)I6r@_+-> Ww� v ªJª � �rnQ� v ªJª � `5�knQ� v ª1ª v +J�rn� v ª1ª y +J�rnP6r@ER1W�P6�6 � [3[e6"%5'*)}V � BDH1<�+]'*),7=R"4(7E7N)?H1%HJ%^93HaF ��+-%3)?%3),+-% �i<L+-Z/Z_+-<m)?7m+-[3[3>?)?6�'C@EH�*+1%(7N�P<E)}@8WPU]6rBD6"<E6"%5Rr6�7�@=H@E<E+J'*)}@E)OHJ%(+->5��+-%3)?%3),+-%/21<L+-Z/Z_+-<E)?+1%(7�)?%(Rr>?4('*)?%32K��+1%3)O%()+-%5' W 9(+1<N@E<E+19(+-<E)m+1<=6/+->,7NHd21)?:16�%�@E936"<E61W�$&A16�<8� �Y'*),7ERr4(7E7N687 WI95+-<=@=<L+-9(+1<=)S+ 7SF H1<E�H1%dZ/6�+1%(7"W �� � B�� D@R�� R

! ��� $&%�@=936��+-%()O%3),+-%b21<L+-Z/Z_+-<8n1FQ9PAb'*H�A1HJ4�%36"68'b�a+1<E+1�;+#RL9(+-<=@t@E<E+1%(7NBDH1<EZ/+-f@=)?H1% ��$&>O>?4(7N@=<L+a@E6iFQ)O@=9�6"V*+1Z/[3>O6^7=6"%\@E6"%(R"6�7 BD<EH1Z�n37=+;AJn*q])?%('*) W! ��� �P93HaF �;+1<E+1�a+S+J7=7=)O2J%3Z/6"%\@E70BDH1< @E936 BDH1>?>OHaFQ)?%32C7N6�%J@E6"%(R"6�7 FQ)O@=9/+-%('#FQ)}@E93H143@7=9(+-<E6�'#�a+-<L+-�a+17�Wm�P93HaF @=936Q<E43>?6�7�`PAKFQ9()?RL9/7N95+-<E6�'#�;+J+-<L+-�a+17 +-<E6G)?'36"%\@=)OT(6�'�WG��$&%R"+J7N6CH1B +-Z#`3)?2143)O@�Ab7=93HaF Z/H1<E6i@=9(+1%�HJ%36+17E7N)?21%(Z�6�%\@L�� { � �;{>{P� { ���!{>{ � {>{ ���!{7{A��{,�;{ � {>{ � �>� � �>����{>{ �>�!{7{ � �!{,��{ � {,�;{>{

!{P� � �>��� �!{ � � ���;� }>{,��} � �!{,�>}7� �>�!� � � � ��� �!�P� } �;} � ���� { � � ��� }�{,�>} � � �>�� � !{P����} � ���!�2� }��>�!� � � � ��� �;{,��}7� �

� | � �;{>{P� {��;{�� �!{��;{>{ �>�!{7{ �!��� � {>{`���!{7{A��{,�;{ � �;{,�;{ � {,��{>{ !{P� �7� �>� � ��� �A���>�P�!} � �!{ � � � � � }>{,��} � �!�2� }��;} � ���� { � � ��� }�{,�>} � { �A�!�>�.�!} ��� !{P���;} � ���!�P��}��7� �>� � ��� � � { � � ��� }�{,��} � { �7� �7� � ��� �.���>�.�!} � � !{P����} � ���!�2� } ��

! �����+\�S�*93HaF @=936�Z/H*'*)}T56"<=f Z/H*'*)OT(6�'�@=<E6"6�FQ)}@E9��a+-<L+-�a+_<E6">,+a@E)OHJ%(7"n�:J6"<E`*f :J6"<E`�<=6�>?+-f@=)?H1%57"n*6"@ER-WpBDH1<G@=9(6^7N6�%J@E6"%(R"6C21)?:16"%d`e6">?HaFu�;{>{P� { � } |;}�� � �!{A�!{,�;{ �7{>{ � {>z>{ � {A�!{>{ � } �;} z����;{ !{P� �A� } { � �>}7� ��� �A�>�!� ��� �!�7�,} �;� � �7�>�A�

�;{ � �>����} ��� � {,�!�>�7z7{>{��!���;{7{ �7�>�A� � ��� � } �>� }�z � { � }� !{P� � { � } { � } �>� }>z �;� �7��} �7�>�A� � �,� �7�7�A� � ��� �;�>�,}{ � ��},� � ���>�!� ��� �;�� � ��

�P93HaFy+1>O>e[(+-<L7=6�7�BDHJ<p@=9(6S7=6"%\@=6�%(Rr6JW � [(+-<L7=6]FQ93),RL9�R"+-%(%3H-@ `56S<=43>?6�'/HJ4*@IHJ%_@=9(6`(+J7N),7YH1Bt7NAP%\@E+-V�7=93HJ43>?'�`56/7N9(HaFQ%�W#��op%32J>O),7N9�@=<L+-%(7=>?+-@=)?H1%U),7S7=93HaFQ%UBDHJ<iR"H1%P:16"f%3)?6"%(R"61W�$l@]Z/)?219\@�n39(HaFI6�:16"<8n\%3H-@Y7=93HaF +1>O>�[5+-<L7N687"W��

Page 93: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� �n��! � � � �� #(v�D`e� �*93HaF @=936i�a+-<L+-�a+KRL95+-<=@tBDH1<�) [(+-�a+1+1%(+1+E+5��RrHPH1�3�knP`e6rBDHJ<=6C+-%('b+aB @=6�< @=<L+-%(7NBDH1<=fZ_+a@E)OHJ%�W��R8� gy9(+a@]),7G@E936^7N95+-<E)O%32�<E43>O6iBDHJ<Q�;+1<N@L+�H-B�) [(+1�;+J+-%(+J+,+?W! � ���+\��UQ6"[e6�+-@Yo�V*6"<LRr),7=6 � W y ��+J�pBDH1<G@E936CBDH1>?>?HaFQ)O%32_7=6"%\@=6�%(Rr6Ju

�;{>{P� { � } ���A�!{ � { � } ��{��!{7{ � � � ����{>{P��{ � ���7{,�;{7{ �;};� � � �;{ � �>� !{P� ��� } �!�A�!{ � ��� } � {��� �,�!{,� � �>�;{P� �,��� � � � �7�!{��� !{ � �

���!{>{ � {>{ ���!{7{,��}��>�;}�{>{��;{2��>� � �>� �;{ ��� �7����}�|!{ � {,�;{>{ �;}��� �>��� }�{,�;� ��� ��{ � � �c� �>���7�>��} ��{A�;} �� !{P� �;�>z�� �;���!{ � �7�;{,� � ����{P� �7��� � � � �7�!{��� !{ � ���{A�!} � { � �>�A�7����} � � �7�;} � { � �>���,z7} }�{,�!� ��� ��

�D`e�Q�P93HaF @E936�a+-<L+-�a+/RL9(+-<=@ BDH1< ) �;+19(+1+E+���7E+-),'(�kW��R8� ) �P)>+\),7I+K[3<=6"f [eHJ7=)O@=)?H1%_Z_+-<E�16�<�W gy9(+a@GRL9(+-%(216�7tFQ)O>?>�A1HJ4_Z/+1�16S)O%_@E936i[(+-<L7N6�<7=H�@E9(+a@^R"H1%(7N@=<L+-)?%\@E7C+-<E6�7=6r@43[s[3<EH1[e6"<E>?A1W����P93HaF `3<E)O6]\(A�+-%5'�[3<E6�R")?7=6">?AUFQ9(+-@<E43>O6\��7L� FQ)O>?>�216"@YRL9(+-%(216�'�W �! ��! gy9(+-@ ),7p@E936C+-21<E6"6�Z/6"%\@t<E43>O6S`56"@�FI6�6"%�:16"<E`�+-%5'_%3H14(%b)?%bq])?%('*)�+-%5'�93HaFFQ)?>O>�AJH14d9(+-%5'*>O6C)O@])O%d@E936^��+-%3)?%3),+-%bBD<E+1Z�6�FIHJ<=��W! ��� gy9PA�'*H/F 6^7N6�[(+-<L+a@E6S2J%3[�BD<=HJZjX � X BDH1<]:J6"<E`(7 �! �����+\�Q�P93HaF �;+1<E+1�a+#+J7=7=)O2J%3Z/6"%\@GBDH1<G@E936CBDH1>?>OHaFQ)?%32/7N6�%\@=6"%5Rr61u

�;{>{P� { � } � } � {`���!{7{ � }`�;} z����;{ � {��!� � �>� � } �7{>{A�>�>� !{P� { �7� z7}��;� � }�{,� � };� � �7|!����� ��� } � � � � }

z7}���{��;{ �A���7z7{A��{>{ ����{>{,�;{>{ �!{ � � ���;� �;{.�!} � � }>}�z ��}P��� � }-���� { � � ��� �;{A�;} � { � � � � } � ���P� �7�;} � };� � �7|!����� � !{2�� }>}�z,}-� �7�;} { �>� z7}�����}�{,� �

�D`e� � >,7NH�7=93HaFy@E936^7N95+-<E6�'��;+1<E+1�a+17�W! ��� �\@L+a@=6C@E936%3HJ43%*fl:16"<E`�+121<E6"6�Z�6�%\@G<E43>?6C)O%Uq])?%('*)�BDH1<8u��+J�G�P)?Z/[3>O6^7=6"%\@E6"%(R"6�7��`5� �IH1Z/[3>?6rVd7N6�%J@E6"%(R"6�7��qY)O%\@8u��pH14wFQ)O>?>Q9(+;:16�@=H 7N@E+-@=6�)}@_)?%w@=6"<EZ_7/H-Bi�;+1<E+1�a+17�+-%('�[5H\7�@=f [eHJ7=)O@=)?H1%(+1>Z_+-<E�16�<E7�W �! ��� {3HJ<G@=936^7=6"%\@E6"%(R"6�7G21)?:16�%�`e6">?HaF

Page 94: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

#Jz ���������� � ��� ��%�$&%$&�% � �� � � ��

��+J�S�P93HaF�@=936#�a+-<L+-�a+_<E6">,+a@=)?H1%57Q@=95+a@iR�+-%U`e6#HJ`*@E+1)O%(6�'U`PAd:\)?`39(+1�\@=) )O%*BDHJ<=Z_+-f@=)?H1%�n*) W 6JWOn(�;+1<E+1�a+#RL9(+1<N@L7"W��`5�_�P93HaFj`\A�'*H-@=@=6�'w>?)O%(6�7�@=9(6U<=6�>?+-@=)?H1%(7#@=95+a@�R"+1%�`e6UH1`*@L+-)?%36�'�`PA��a+-<L+-�a+7N9(+1<=)?%32�<=4(>O687"n*:J6"<E`*f :J6"<E`�<E6">,+a@=)?H1%d<E43>O6Jn*6r@LR-W��R��G.0)?7N@G@=936<E43>?6�7 @=95+a@]A1HJ4�95+;:16i4(7N68'd)O% �D`e�G+-`eHa:161W� �� � { � }�|!{��>�,} ��� � � � �;{A�!{ � {��>�!{ � }c�!} z>����}`�!{��!{>{

�;} ��� } �A���7z�� {��>� �|;�>�A� �;� � ��}>{�� � �!} � z�����} { � �!}-���� } { � �!}-���,�;} �A���,z�� �;� �>}�{�� �7�;} |!�>�A���

� �� � { � }�|;};� � ��} �>�;} |;{��>�,} �!� � � � �;{A��{ � {��>�!{ � }c�!} z��A��}�;} ��� } � }�{,��}�� �.���7z�� {>�>� x|!�>�.� ��� � ��}�{� � �!} � z>����}

��{��!{7{ { � �!}����� } { � �!}-���,�;} � }�{���}-� �A�!�7z�� �;� ��}�{����,�;} |!�>�.� ��

B �� � { � }�|;};� � ��} �>�;} |;{��>�,} �!� � � � �;{A��{ � {��>�!{ � }c�!} z��A��}�;} ��� } � }�{,��}�� �.���7z�� {>�>� x|!�>�.� ��� � ��}�{� � �!} � z>����}

��{��!{ � {>{ �7{>{A�!{>{ �;� � { � � �!{ � ��}-���� }��;{ � ��}-� ����{ � � �7�;} � }>{,��}-� �A�!�7z����;� ��}�{����,�;} |!�>�.� ��

� �� � { � }�|;};� � �;{,��}��>�;} |!{��>��} ��� � � � �;{A�!{ � {��>�!{ � }c�!} z>����}�;} ��� }��!{ ��� ���>�!� �>� �A���7z� {��>� �|;�>�A� �;� � ��}>{�� � �!} � z�����}

��{��!{7{ { � �!}����� } { � �!}-���,�;} �A���,z����>�!��;{ � � � �7�;} � �����,} �>� � � � ���>�;� ����;� �>}�{�� { |;�>�A� ��

� �� � { � }�|!{��>�,} ��� � � � �;{A�!{ � {��>�!{ � }c�!} z>����} |�� � �!{>{,��{>{�;} ��� } �A���7z�� {��>� �|;�>�A� �;� � ��}>{�� � �!} � z�����} �7{A� � }��;� � ������ } � {���}��7��} �A���7z� � ������� ��}�{����7�;} |!�7�A� ���� �����

� �� � } |�};� � �!{.��{,�;{ |!{��>��}c��{>{ � � � �;{.��{ � {��>�;{ � {>{ {��7�A�!{>{�;}c�;{ � � ������� {,� �;�� � �A���7z� � } � �|!�>�A� ��}�{�!� ��� � �>���

� {����7��� z>{ � {>{ � �,� z>�.�!}��� }��;�� � �,� z��.�!}��,�;} �A���,z�����}�{�!� ��� { |;�>�A� �!{ � � ��� � {,��;�� � ��

� �� � } |;{��>�,} �!{>{c|;};� � �!{A��{��;{ � � � �;{A�!{ � {��>�!{ � {>{ {��>�.�!{>{�;} �7�7z�� � } � x�!{ � � ���;��� {,�1�;�� � |;�>�A� ��}�{��!� ��� � �>��

Page 95: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� �n��! � � � �� #�y

� {����7��� z>{ � {>{ � �,� z>�.�!}��� }��;�� � �,� z��.�!}��,�;} �A���,z�����}�{�!� ��� { |;�>�A� �!{ � � ���� {,���;�� � �

! ����� $&%/R�+17=6GH-B�ZK43>O@=)?[3>?6][(+-<L7=6�7Q�DHJ`*@E+1)O%(6�'�`PA^A1HJ43<�<=4(>O687E� )?%�@=936Y+1`5Ha:J6I6"V*6"<=fRr),7=61n8Z/+1<=�Y@=936�[(<=6"BD6"<E<=68'S[5+-<L7N6Jn")OB*+1%PA1W�$&%68+1RL9CR"+17=6�)?%('*),R"+a@E6�FQ9(+a@m)O%*BDHJ<=Z_+-@=)?H1%R"+1%�`e64(7=6�'�@=H/HJ`*@E+1)O%d@=9(6[3<=6"BD6"<E<=68'�[(+1<E7=6CZ/6�RL9(+1%3)?R�+->?>OAJW! ��� � ZY6"T(%36K�a+1<E+1�;+/RL9(+1<N@L7GBDH1<Y@=936#:16�<=`(7])O%�7=6"%\@=6�%(Rr687])?%�o�V*6"<LRr),7=6 z W v W � <E6A1HJ4�+1`3>O6i@EH/'36"<E)O:J6S@E9367�@E<=45Rk@=4(<=687 BDH1< @=936^7=6"%\@E6"%(R"6�7G4(7=)O%(2#�a+-<L+-�a+�RL9(+-<=@E7G+1%('�a+-<L+-�a+K@=<L+-%(7NBDH1<EZ_+a@=)?H1%�<=4(>O687 �! ��� � "+-<L+-�a+�RL9(+-<=@E7'*687=R"<=)?`e6�'h936"<E6b7=[568Rr)OBDA�BDHJ<^6�+JRL9~�a+1<E+1�;+(n�@E936�:P)O`(9(+-�\@=)<E6�c\43)?<=68'h+1%('hFQ936r@E936"<KZ/+1%('3+-@=H1<EA�HJ<%3H-@8W�$lBQF 6�RrHJ%(7N),'*6�<^:16�<=`(7C>?)?�167) �a+-9(+E+��7E+;A3�kn\@=9(6")?<G+1<=2J43Z/6"%\@i���a+-<EZ/+K�a+-<L+-�a+J�p)?7 +#7=6"%\@E6"%(R"6i+1%('_%3H1@#(�4(7N@]+^%3HJZ/)O%(+1>�WXUHJ<=6�Ha:16"<8n-@E936C+-<E2143Z/6"%\@ HPR�Rr43<L7t@=H#@=936C<E)O2J9J@ H-B�@E936C:16�<=`b+1%('�%(H-@ @=H#@=936i>O6"B @�W�p<EHa:P)?'36tBDHJ<t7N[e6�R")}TeR"+a@E)OHJ%_H-Be@=93687N6Y)O%*BDHJ<=Z_+-@=)?H1%(7�)?%/@=9(6]�a+-<L+-�a+CRL9(+-<=@�W �i)O:J6@=9(6K�a+-<L+-�a+�RL9(+1<N@YBDH1<V) �a+-95+,+m��7=+;A3�])O%U@E936�6rVP@=6�%('*6�'UBDH1<EZ @E9(+a@i)O%5Rr>?4('*6�7Y@=9(6�7=6)?%*BDH1<EZ_+a@=)?H1%57"W

Page 96: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

# © ���������� � ��� ��%�$&%$&�% � �� � � ��

Page 97: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� �

� � � � � ����� �

�_ �� ��������������� ��!"�#�$&%h@=93),7KRL95+-[*@E6"<8n0F 6�'*)?7ERr457=79(HaF +�[(+1<E7=6"<^R�+-%s`56b`343)?>}@K457N)?%32�@=9(6���+-%3)?%3),+-%BD<L+-Z/6"F H1<E��Ww$l@_@E43<E%(7/H14*@_@E9(+a@_@E936���+1%3)O%()?+1%�@=9(6"H1<EA�),7_6rVP@E<=6�Z�6�>OA�7N43)O@E+1`3>?6BD<EH1Z @E936]RrHJZ�[(4*@E+-@=)?H1%(+1>*:\)?6"FQ[eH1)?%\@�W�XG93),7�)?7p7=Hi[(+-<=@=>?A^`e6�R"+14(7=6I@E936Q21H\+->PH-Be@=9(6��+-%()O%3),+-%/@E936"HJ<=A/Z_+a@LRL936�7IFQ)O@=9�@=936i21H\+->(H1B��Y.m��H1B06rVP@=<L+1Rr@=)?%32^Z/6�+1%3)?%32^BD<EH1Z+-%�4*@=@=6�<E+1%(Rr6JWIXG936C@E936"HJ<=AdR"+-%�`e6^4(7=6�'d)?%�+/%(+a@E43<E+1>�Z_+-%3%36�<QBDH1<S7�@E<=4(Rr@=43<E)?%32+�[(+-<L7=6"<GFQ93),RL9d),7G6rVP@E<=6�Z�6�>OAb6r��Rr)?6"%\@�W

XG936�T(<L7�@/[(+-<=@/H-B]@E936�[(+-<L7N6�<#Z#4(7N@#@L+-�16�R"+1<=6�H-BYZ/HJ<=[39(H1>?H121AJW {3H1</68+1RL9F H1<L'#)?%/@=9(6])O%([34*@ 7=6"%\@E6"%(R"61nJ+K'*)?Rr@=)?H1%(+1<=A#H1<t+C>?6rV*),RrHJ%_%36"68'37�@EH`56S>OHPH1�J6�'�43[�n+-%5'U+17E7NH*Rr),+a@E6�'�21<L+-Z/Z_+a@E)?R�+->�)?%*BDH1<EZ_+a@=)?H1%�%36�6�'37]@=H_`e6K<E6r@E<=)?6":J6�'�W XG936FIHJ<E'(79(+;:J6_@=Hh`56�21<EH143[e6�' @=H12J6r@E936"<�AP)O6�>?'*)?%32~%3H1Z/)?%(+->,7"n�:J6"<E`(+->,7^6"@ER1Wh{ )?%(+->?>OAJn�@=9(6�a+-<L+-�a+�<E6">,+a@E)OHJ%(7C+-Z/H1%(2�@=9(6�6�>O6�Z/6"%\@E7C9(+;:J6^@EH�`e6/)?'*6�%\@=)OT(6�'�W/XG93),7i)?77=93HaFQ%)?%�{ )?2143<E6 � W v �D<E6"[e6�+a@E6�'bBD<=HJZ �I9(+1[�W z �rWXG936�[(+-<L7N6�<#),7#`(+17=6�' H1%�)?%*BDH1<EZ_+a@E)OHJ% @=936�H1<E6r@E)?RdRrHJ%(7N),'*6�<E+-@=)?H1%(7KFQ936"<E6�+-@6�+JRL9b7N@E+-2J6YH1B0[3<EHPR"6�7E7N)?%325n](�4(7N@G@=936i<E)O2J9J@G+-Z/H14(%J@GH-Bm)O%*BDHJ<=Z_+-@=)?H1%�),7 6rVP@=<L+1Rr@=6�'�W� @�@=9(6]Z/H1<E[393H1>?H12J)?R�+->P+-%(+1>OA*7=)?7�7N@E+1216Jn-)O%3BDH1<EZ/+-@=)?H1%/+;:a+-)?>?+1`3>O6 BD<EH1Z FIHJ<E'KBDH1<EZ_7),7bHJ`*@E+1)O%368'�W {(H1<�6rV3+-Z/[3>?61n])?%*BDHJ<=Z_+a@E)OHJ% +-`eH143@�216�%('*6�<b%P43ZK`e6"<8n][e6"<L7NHJ%y)?7H1`3@E+-)?%368'��DFQ936�<=6�:16�<p[5H\7=7=)?`3>O6;��BD<EH1Z @=9(6Y%3HJ43%(7�W � %�@=936SH-@=9(6"<t95+-%('�n\BDHJ<t:16�<=`57)?%~q])?%('*) n�2J6"%('*6�<S%P43Z#`56�<C[56�<E7=H1% ��21%3[e�Y+1%('�[(+1<N@CH-BtX � Xx),7SHJ`*@E+1)O%(6�'�BD<EH1Z@=9(6#F H1<L'37�WY$&%~R�+17=6KH1BtX06�>O432J4�:J6"<E`(7"n5@=9(6�R"H1Z/[3>?6r@=6�X � X >,+-`e6"> n�`5687N),'*687Y2J%3[),7GH1`*@L+-)?%36�'�+17GF 6">?> W$&%y@E936~>?H*R"+1>SF H1<L'y21<EH14([3)O%(2 7�@L+-2J61n]F H1<L'37bR"H1Z#`3)O%(6�)?%J@EH�2J<=HJ43[(7~�D%3HJ43%21<EH14([(7m+1%(':J6"<E`^21<EH143[57E��`(+17=6�'KH1%^>?H*R"+->P)?%*BDH1<EZ_+a@E)OHJ%�WmXG936 21<EH14([(70+1<=6tBDH1<EZ�68'FQ)O@=9^Z/)?%3)OZ_+1>JRrHJZ/[34*@E+-@=)?H1%(+1>-6r��H1<=@I�DT(%3)O@=6I7N@E+-@=6pZ_+JRL93)O%(6pZ/HP'36"> ��+170H1%3>?AS>?H*R"+1>)?%*BDH1<EZ_+a@=)?H1%),7�457N68'�W � %@E936tH1@=936�<09(+1%('�n;>?HPR�+->JFIHJ<E'i21<EH14([3)O%(2Q`3<=)?%32\7�@=HJ216"@=936�<

(�4(7N@�@=936G<E)O2J9J@ )O%3BDH1<EZ/+-@=)?H1%d�D:P)O`(9(+-�\@=)PBDHJ<�%3H143%57"n-X � X >?+1`56�>?7mBDHJ< :J6"<E`(7L��@E9(+a@�)?7%36�6�'*68'�BDHJ<G@=936%36"VP@Q7N@E+1216iH-B�[3<EHPR"6�7E7N)?%32d� @=95+a@]),7"nPBDHJ<Q�;+1<E+1�a+#+J7=7=)O2J%3Z/6"%\@L�rW�$l@# �

Page 98: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

# � ���������� � ��� �%$&%�$&��%�� � ���

� } � �>} � �,} �>�7�>� � ��� � {��,} z7} � }�z��

� �>�7�>�>�>�>�7�>�>�>�>�7�>��� �>�>�>�>�>�7�>�>�>�>�7�>�>�>�>�7�>�>�>�>�7�>���� {��A�!� � } z7} �!�>�7� � � �>�>�>�7��� � ����� � �!�>z7� � �>�7{7zs{ � {>z�����}7� ��>�>�7�>�>�>�>�7�>�>�>�>�7�>� � �>�>�>�>�>�7�>�>�>�>�7�>�>�>�>�7�>�>�>�>�7�>���

�;�,�1� � � �����7� { �>� ���>�,{,��}-�� �;{P�>��{��!�>�7{>z � � ��� �,�.��{,�!�7� �

�� �>�7�>�>�>�>�7�>�>�>�>�7�>�>��� ���>�>�7�>�>�>�>�7�>�>�>�>�7�>�>�>�>���� � },�7| � �,�.� �A�!{,�>� � �>�>�>�7��� � z>���,{>z��!�,�1� � �;��� � }7� ��>�>�7�>�>�>�>�7�>�>�>�>�7�>�>� � ���>�>�7�>�>�>�>�7�>�>�>�>�7�>�>�>�>���

�;�,�1� � � � �;��� �!� �>�7�>� � �A|7�!{A�;�!��z,} � }�z� �>�7�>�>�>�>�7�>�>�>�>�7�>�>�>��� ���>�>�7�>�>�>�>�7�>�>�>�>�7�>�>���� ��{��;{A��{ �A�;{,�>� � �>�>�>��� � �,�,��} � {�� � }7� �� z>{.� � �!{ � �.�!{,�>� � � � ��>�>�7�>�>�>�>�7�>�>�>�>�7�>�>�>� � ���>�>�7�>�>�>�>�7�>�>�>�>�7�>�>���

�� {,� � } � � �>�7���A�7����} �>�7�>� ��{,��{A��{�z7} � }�z

{ )?2143<E6 � W v up�\@E<=4(Rr@=43<E6H-Bm@=936^��+1<E7=6"<

Page 99: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,��� �� �� � � �,�� # �

'*HP6�7p%3H-@t+-@N@=6�Z/[*@p@=H^'3)?7N@=)?%3214()?7=9_+->?>*@=936]T(%36]7=9(+1'*687�H-B�Z/6�+1%3)O%(2(n-BDHJ<�6rV3+-Z/[3>?61n@=6�Z/[5HJ<E+1> 7N@=<E4(Rk@E43<E6�HJ<#Z/H*'3+->?)O@�A1W {3HJ<#HJ%36b@E93)?%32(nt7=4(RL9�)?%*BDHJ<=Z_+a@E)OHJ%�R�+-%3%3H1@6�+J7N)?>?A_`56^'*6"@=6�<=Z/)?%36�'d+a@G@=9()?7Q7N@E+1216iH-Bm[(<=H*Rr687=7=)?%32(Wp�P68RrH1%5'*>OAJnP)}@]),7G%3H-@Q%36�6�'*68'BDH1<G@E936%36"V\@Y7N@E+1216JW� 7�Z/6"%\@=)?H1%(6�' 68+-<E>O)?6"<8nQ@E936~HJ4*@=[(4*@UH-B^@E936~>?H*R"+1>SF H1<L'y21<EH14([56�<b<EH1432J93>OARrHJ<=<E6�7=[eH1%('37t@=H�@E936:P)O`395+-�\@=)�>?6":J6"> W�qYHaFI6�:16�<�nP)?%b@E93HJ7=6iBD6"F R"+17=6�7 FQ936�<=6S@=9(6"<E6),7t+-Z#`3)?2143)O@�A#)?%�),'*6"%\@E)}BDAP)?%32@=9(6Y>?HPR�+->5FIHJ<E'/2J<=HJ43[(7p+1%('�@=936i+-Z#`3)O2J43)O@�A�R�+-%3%3H1@`e6S<E6�7=H1>?:168'�+a@ @=9(+-@ >?6":J6"> n\@=936C'*6�R")?7=)?H1%�),7 [5H\7�@E[5HJ%36�'�Wp{(H1< 6rV3+-Z/[3>?61nP)?%�qY)O%('3)�n+sF H1<L' @E9(+a@dR"+-% `e6�`eH-@=9 +s%(H143% +1%(' +-%y+1' (�68Rk@E)O:J61nQR"+14(7N687�+-Z#`3)?2143)O@�A )?%BDH1<EZ/)O%(2/+/>?H*R"+1>�FIHJ<E'�21<EH14([�FQ)O@=9�)O@E7Y7=4(R�Rr6"68'*)?%32/%3H143%0WtXG936KRL93HJ)?R"6R"+-%dH1%(>OA`e6#Z_+1'36K>,+a@=6�<i'343<=)?%32d�a+-<L+-�a+�+17E7=)O2J%3Z/6"%\@Y4(7=)O%(2b�a+-<L+-�a+bRL95+-<=@E7�W � 7C+b<=687N43>O@�n)?%hHJ43<^)?%*BDH1<EZ_+a@E)OHJ%�@E936"HJ<=6"@=),R/[(+-<L7N6�<�nm7N4(RL9 +URL93HJ)?R"6/)?7^'36">,+;A16�'�@=H�@E936�[eH1)?%\@FQ936�%�)O@]R"+-%�`56CZ_+1'361Wt�P)?Z/)O>,+-<G),7 @=936R"+J7N6iFQ)O@=9�+K%3HJ43%�@=9(+-@G),7IBDH1>?>OHaF 6�'b`PA�+Z_+-<E�16�< �a+J+�n*�J6H1<G�P)O)m+-%('d7N45R"Rr6�6�'*68'd`\A�+#%(H143%U+17G)?%�uz>{��;{.�!} � �>� � ���;{>{A|!{|!�,� � � |;�>�A�

� B @E6"<_@E936�>?H*R"+->YFIHJ<E'w21<EH14([3)O%(2s7N@E+1216Jnt@E936"<E6U)?7b�a+-<L+-�a+s+17E7N)?21%3Z/6�%J@�+1%('>?6rV*)?R�+->�'*),7=+1ZK`3)?2145+a@=)?H1%~7�@L+-216JWKXG93),7i)?7'*HJ%36�%36rVP@C`568R"+-457N6�@=9(6#%368Rr687=7E+-<EA�)O%*fBDH1<EZ_+a@E)OHJ% �D:P)?`39(+-�\@E),�^BDH1<�'*H1)?%32�)O@/)?7/+;:a+-)?>?+1`3>?61W � @E936"<�[3936�%3H1Z/6�%(+�7=4(RL9 +J7c\4(+-%\@E)}T(6�<E7+1%('s+-%(+1[393HJ<E+d+-<E6#%(H-@^9(+1%('*>?6�'s+a@@E93)?7K7�@L+-216Jn0`e6�R�+-4(7=6/)O%*BDHJ<=Z_+-f@=)?H1%dBDHJ<Q<=687NHJ>O:P)?%32K@E936"Z )?7G%(H-@Y+;:a+-)?>?+1`3>?61WXG93),7p+-[([3<=H\+1RL9#)?7pR"H1%(7=),7�@E6"%\@pFQ)}@E9/@=936Y$&%('*),+-%/21<L+-Z/Z_+a@E)?R�+->3+-%5+->?AP7=),7�FQ936"<E6Z/6�+1%3)O%(2�),7Q6"V\@E<E+JRk@E6�'�)?%U7N6�:16�<E+1>e>,+;A16�<E7 FQ)O@=9�)?%(Rr<E6�+J7N)?%32�[3<=68Rr),7N)?H1%0W

�_ .- ���K�T0 � ��T8P0]��i)?:16"%s@E936�>?H*R"+->tFIHJ<E'h21<EH14([(7C)O%�+U7=6"%\@E6"%(R"61nm@=936_@L+17=�~H1BI@E936bR"H1<E6_[(+-<L7N6�<)?7@�F H-f BDH1>,'�uv W]X0H/),'*6"%\@=)OBDAb�a+1<E+1�;+#<E6">,+a@=)?H1%57 +1Z/H1%32/F H1<L'�21<EH14([(7"nz W]X0H/),'*6"%\@=)OBDA�7=6"%57N687GH-BmF H1<L'37�W

XG936#T(<L7�@S@E+17=��<=68c\43)O<E6�7Y�P%3HaFQ>O68'*216#H-Bp�a+-<L+-�a+-f :P)?`39(+-�\@E)0Z_+-[3[()O%325n�H1[*@E)OHJ%(+->?)}@�AH-B�a+-<L+-�a+J7"n +-%('w@E<E+1%(7�BDHJ<=Z_+-@=)?H1%w<=43>?6�7�W XG9(6�7N68RrHJ%('�@E+17=� <E6�c\43)?<E6�7/>,+-�*7N95+-%RL9(+1<N@L7tBDHJ<]%3HJ43%(7Q+-%5'b:J6"<E`(7"n*FQ9()?RL9dFQ)O>?>�`e6^'*),7=R"4(7=7=6�'�>,+a@=6�<�W� '3+a@L+�7�@E<=4(Rr@=43<E6/R"+->?>?6�'~�;+1<E+1�a+bRL9(+1<N@^7N@=H1<E6�7S)?%*BDH1<EZ_+a@=)?H1%s+-`eH143@C�a+1<E+1�;+-f:P)O`(9(+-�\@=)�Z_+-[([3)O%(2�+1%('bHJ[*@=)?H1%5+->?)}@�A/H-B �a+-<L+-�a+17pBDH1<G6�+JRL9bH-B0@=936C:16�<=`�21<EH143[57t)?%+_7=6"%\@=6�%(Rr6JW�$&%3)}@E)?+1>O>?A1n3@=936^'*6"B�+-43>O@Y�a+-<L+-�a+�RL9(+-<=@Q)?7]>OH\+1'*68'b)?%\@=H�+/�a+-<L+-�a+�RL9(+-<=@BDH1<S+#2J)O:J6"%�:16�<=`d21<EH14([�)?%�@=936^7=6"%\@E6"%(R"61WtXm<E+1%(7NBDH1<EZ/+-@=)?H1%d)?7][56�<NBDHJ<=Z/6�'�4(7=)O%(2@=9(6SX � X >,+-`e6"> W�XG936"<E6]),7I+^7=6"[5+-<L+a@=6Q�a+1<E+1�;+RL95+-<=@pBDH1<I6�+1RL9_:J6"<E`/21<EH143[_)?%_@=9(67=6"%\@=6�%(Rr6C`e6")?%32_[3<EHPR"6�7E7N68'�W

Page 100: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

# # ���������� � ��� �%$&%�$&��%�� � ���

� ��� ���!� % ��� ) ����� � � � ��� � � � �"+-<=@E+ � Z/+1%('3+-@=H1<EA"+-<EZ/+ �JH#HJ<�� Z/+1%('3+-@=H1<EA"+-<L+-%(+ 7=6iHJ<]'*:a+1+1<E+J+ HJ[*@=)?H1%5+->

{m)?214(<=6 � W z u3ZS6rB�+143>O@]�;+1<E+1�a+#RL9(+1<N@GBDHJ< ) �P9(+J+K<L+-�P9(+J+,+

� %s6"V*+1Z/[3>O6_'*6"B�+-43>O@^�a+-<L+-�a+dRL9(+-<=@CBDH1<�P9(+1+s��6�+a@k�i)?7^21)?:16"%h)?%s{ )?2143<E6 � W z�D<E6"[e6�+-@=68'hBD<=HJZ RL9(+1[*@=6�< � �rW�$l@#7N9(HaF]7CBDH1<#6�+1RL9sH1B @E936��a+-<L+-�a+J7)}@L7^%368Rr687=7=)}@�A�DZ_+1%('3+a@EH1<EA1n3'*687N)?<L+-`3>?61nPH1<QHJ[*@=)?H1%5+-> �kn3+-%5'�:P)?`39(+1�J@E)�W{3HJ<K+U2J)O:J6"% 7N6�%\@=6"%5Rr6�+aB @E6"<K@=936�F H1<L'h21<EH143[579(+;:16_`e6"6�%sBDH1<EZ/6�'�n��a+-<L+-�a+RL9(+1<N@L7 BDH1<�@E936Q:16�<=`�21<EH143[57�+-<E6GR"<=68+a@E6�'/+-%('�68+1RL9�H-Be@=936]%(H143%/21<EH14([(7�)?7�@=6�7N@=68'+-2\+-)?%(7N@_@=936~�;+1<E+1�a+s<=687�@E<=),Rk@E)OHJ%(7_)?% 6�+JRL9y�;+1<E+1�a+ RL9(+-<=@~�D[(<=Ha:P),'*6�'�@=9(6�%3HJ43%21<EH14([U)?7]@=H�@E936K>?6rB @CH-B�@E936K:J6"<E`U21<EH143[�FQ93H\7N6#�a+-<L+-�a+_RL9(+-<=@Y),7]`e6")?%32�@E6�7N@=68'(�kWgy936�% @=687�@E)O%32~+�%3H143% 2J<=HJ43[ +-2\+-)?%(7�@K+��;+1<E+1�a+�<E6�7N@=<E),Rk@=)?H1%sH1BQ+�:16"<E`s21<EH143[0n:P)O`(9(+-�\@=) )?%*BDH1<EZ_+a@=)?H1%U),7YRL9(6�RL�168'�n�+-%('�)OB�BDH143%5'�7E+a@=),7NB�+1Rk@EH1<EA1n*@E936K%(H143%�2J<=HJ43[`e6�RrHJZ/6�7�+CR"+-%5'*)?'(+a@=6IBDH1<�@E936G�a+-<L+-�a+]H1B(@=9(6 :J6"<E`K2J<=HJ43[�WmXG9()?7�R�+-%K`e6]7=93HaFQ%K)?%@=9(6GBDH1<EZ H-Be+CR"H1%(7N@=<L+-)?%\@ 2J<E+1[39�W��YH*'*6�7�H1B(@=9(6Q21<L+-[39�+-<E6t@E936GFIHJ<E'K21<EH143[(7�+1%('@=9(6"<E6t),7 +1%K+-<LR�BD<EH1Z +Y:16"<E`^2J<=HJ43[C@=HC+]%3HJ43%^2J<=HJ43[^>,+-`e6">?>O68'^`PA+]�a+-<L+-�a+3n;)OB3@=9(6%3HJ43%�21<EH14([�7=+-@=),7�T56�7Y@=936��a+-<L+-�a+_<E6�7N@=<E)?Rr@=)?H1%U)?%�@=9(6#�a+-<L+-�a+�RL95+-<=@SH-B�@E936�:16"<E`21<EH14([�W ��XG936"<E6]),7t+1%�+-<LR BD<=HJZ HJ%36Q:16�<=`_2J<=HJ43[�@=HK+1%3H-@E936"<8n1)OB�@=936Y�;+1<E+1�a+RL9(+-<=@H-Be@=9(6GBDH1<EZ�6�<p9(+J7�+C�;+1<E+1�a+Y<E6�7N@=<E)?Rr@=)?H1%�FQ)}@E9_>O6"V*)?R�+->P@�AP[56]+J7�:16�<=`�H1<p7=6"%\@E6"%(R"61W��XG936_:J6"<E`~2J<=HJ43[(7+-<E6_R"+1>O>?6�'h'*6"Z_+1%('h21<EH143[(7+J7i@=936�A�Z_+-�J6_'*6"Z_+-%5'37^+-`eH143@@=9(6")?<i�a+1<E+1�;+J7"n�+-%5'U@=9(6�%(H143%~21<EH143[(7i+-<E6#R�+->?>O68'�7=H143<LRr6K21<EH143[(7S`e6�R"+14(7=6K@E936"A7E+a@=),7NBDA '*6"Z_+1%('37�W � � :J6"<E`�2J<=HJ43[wR�+-%w`56�+ 7=H14(<ER"6�2J<=HJ43[w+J7/FI6�>O>YFQ936"% )O@7E+a@=),7NT(6�7 @E936^'*6"Z_+1%('dH-B +1%3H-@E936"<Q:J6"<E`�2J<=HJ43[�W�XG93),7"n*9(HaFI6�:16"<8n*'*HP6�7G%3H1@Y+a��6�Rr@)O@E7]7N@E+-@=4(7Q+J7Q+�'36"Z_+-%('d2J<=HJ43[�+J7GFI6�>O> W �� 7Q+1%�6rV3+-Z/[3>?61n3R"H1%(7=)?'36"<Q+_7N6�%\@=6"%5Rr6RrHJ%J@L+-)?%3)?%32K@E936:16�<=`d�P9(+1+���6�+a@k�ku

� � |!{��7�7{>{ �;{>{,�7�!{ � } �;}�z>{>{ ���!{>{��;{>{c�;}�� �A���,z����!{ � � ��� }c|;{ � { � { }�{,� ���� ��} �A���7z���}�{,� � �,�;} |!{ � { � {������,����� � �;{ � � ��

$l@E7CF H1<L'U2J<=HJ43[(7C+-<E6KZ_+-<E�168'�+1%('��P9(+J+~��6�+a@k�S9(+17S@=9(6�7=+1Z�6��a+-<L+-�a+bRL95+-<=@C+J7)?%�{ )?2143<E6 � W v W�$l@E7YRrH1%57�@E<E+1)O%\@G21<L+-[39�)?7]7=93HaFQ%d)O%U{ )?2143<E6 � W y W

Page 101: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,��� �� �� � � �,�� # ª

`(+1R�R"+1+ 9(+1+-@=9(+/7=6 �16�>?+J+ �P9(+J+a@E+J+K9(6")��

� � �

�a+1<=Z_+�a+1<N@L+

�a+-<=@E+�a+-<EZ_+�;+1<E+1%(+

{m)?214(<=6 � W y u �IHJ%(7�@E<E+1)O%\@G21<L+-[39bBDH1<Y7=6"%\@E6"%(R"6��W v

��<>= <@? M � R Q�B,GTD Q,R� [5+-<L7N6),7S+b7N43`3f 2J<E+1[39�H-B�@=9(6#RrHJ%(7N@=<L+-)?%J@]2J<E+1[39�RrHJ%\@E+-)?%3)?%32�+->?>m@=936#%3H*'*6�7YH-B@=9(6YRrHJ%(7�@E<E+1)O%\@p2J<E+1[39_+-%('_7E+a@E)?7NBDAP)O%32C@E936QBDHJ>O>?HaFQ)O%(2^RrH1%5'*)}@E)OHJ%(7Y��RrHJ<=<E6�7=[5HJ%('*)?%32@=H�@E93HJ7=6)O%��P68R-W � W ©(W��ku� v W {3HJ</6�+1RL9�H-BS@=936�Z_+-%('(+a@=HJ<=A �a+1<E+1�;+J7K)?% +��a+-<L+-�a+~RL9(+-<=@#BDHJ</6�+1RL9w'*6rfZ/+1%('h21<EH143[0n�@=9(6"<E6�7N93HJ43>,'~`e6&��� ��� � ��� ��� �^H14*@E21H1)?%32�6�'3216_>,+-`e6">?>O68'~`PA@=936�a+-<L+-�a+KBD<=HJZ @=9(6^'*6"Z_+-%5'�2J<=HJ43[�W� z Wm{(H1<�6�+JRL9KH1B(@=9(6G'36�7=)O<L+-`3>?6GH1<�H1[3@=)?H1%(+1>\�a+1<E+1�;+J70)?%_+Y�a+1<E+1�;+iRL9(+1<N@ BDH1<�68+1RL9'*6"Z_+-%5's21<EH143[�n0@=936�<=6�7N93HJ43>,'s`56 �(� � �(� � ��� �HJ4*@=2JH1)?%32U6�'3216�>,+-`e6">?>O68'`\A�@=936�a+-<L+-�a+KBD<=HJZ @=9(6^'*6"Z_+-%5'�2J<=HJ43[�W� y W�XG936"<E67N93HJ43>,'b`e6 � � �!������ ��� � )?%(RrHJZ�)?%32�+1<ERS)O%\@EH_6�+1RL9d7NHJ43<LRr6C21<EH143[0W$lB07=6":16�<E+1>57=43`*fl21<L+-[3957pH-B0+�RrHJ%(7N@=<L+-)?%J@I21<L+-[39�7E+a@E)?7NBDA�@=936C+-`eHa:16YR"H1%('3)}@E)OHJ%(7"n)O@iZ/6�+1%(7Y@=9(+-@Y@=9(6"<E6#+-<E6^Z#43>}@E)O[(>O6�[(+-<L7=6�7Y+1%('�@E936�7=6"%\@E6"%(R"6K),7S+1ZK`3)?2143HJ4(7�WY$lB%3Hd7N43`3f 2J<E+1[39U7=+-@=),7�T(687Q@E936#+1`5Ha:J6KRrHJ%(7�@E<E+1)O%\@L7"n(@=936�7N6�%J@E6"%(R"6K'*HP6�7S%3H1@S9(+;:J6^+[(+1<E7=61n3+1%('b),7G[3<EH1`(+1`3>?A�)O>?>Of�BDHJ<=Z/6�'�W � [5+-<L7N6C),7Q+->,7NH_R"+1>O>?6�'d+ � �(�� ��� � ����� ���*)*W�IH1%57N),'*6"<#@=9(6�6"V*+1Z/[3>O6�RrHJ%(7N@=<L+-)?%J@�21<L+-[39 )O%w{m)?214(<=6 � W y W XG936�<=6�+-<E6�@�F HH143@=21HJ)O%(2C+1<ER�7�>?+1`56�>O>?6�'�`PAK�a+1<N@L+iBD<=HJZ ) �\95+1+a@L+1+S936")S+?W �IHJ%(7N@=<L+-)?%J@ � v 7E+;A*7 @=9(+-@6rV3+JRk@=>?AH1%(6IH1B(@=9(6G+1<ER�70Z#4(7N@�`e6Q7N6�>O68Rk@E6�'K@=Hi`56G)?%�+C7=H1>?4*@=)?H1%#21<L+-[39�W �P)OZ/)?>?+1<=>?A1nBDH1<]+1<ER�7 >?+1`56�>O>?6�'�`PA��a+-<EZ/+#�a+-<L+-�a+3W�q]HaF 6":J6"<8n\R"H1%(7N@=<L+-)?%\@ � y 7N@E+-@=6�7 @E9(+a@]+1<ER�7>,+-`e6">?>O68'�`PA/�;+1<N@L+K+1%('_�a+-<EZ_+^ZK457�@ %3H-@G`56i)?%(Rr),'*6"%\@GH1%_@E936C7=+1Z�6S%3H14(%�W�XG936"AZK457�@�`56h)?%(Rr),'*6"%\@U'*)O�e6�<=6�%J@E>OA HJ% `(+1R�R"+J+ �D`eHaA3�b+1%(' �J6">,+1+ ��`(+-%(+1%(+J�rW XG9(6+-<LR/>,+-`e6">?>O68's`\Ah�a+-<L+-%(+d),7^HJ[*@=)?H1%(+1>t+-%5's)?7C@EH�`e6b<E6r@E+1)O%(6�'hH1%3>?A�)OB]%368Rr6�7E7E+-<EA`e6�R"+14(7=6YH-B0R"H1%(7N@=<L+-)?%\@ � y W�$&%_@E93),7 R�+17=61n\)}@ @=4(<=%(7IH143@t@=H#`56i%368Rr6�7E7E+-<EAK`e6�R"+14(7=6

Page 102: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

ª � ���������� � ��� �%$&%�$&��%�� � ���

`(+1R�R"+1+ 9(+1+-@=9(+/7=6 �16�>?+J+ �P9(+J+a@E+J+K9(6")� � �

�a+-<=@E+�a+1<=Z_+�a+-<L+-%(+

��+J� � 7=H1>?4*@=)?H1%d21<L+-[(9h��RrH1<E<E6�7=[5HJ%('*)?%32K@EH�@=936Z/6�+1%3)?%32(upRL93)?>,'b68+a@E7G`5+-%(+1%(+J�

`(+1R�R"+1+ 9(+1+-@=9(+/7=6 �16�>?+J+ �P9(+J+a@E+J+K9(6")��

�a+1<=Z_+�a+1<N@L+

�a+-<L+-%(+�D`5� � %3H-@E936"<S7NHJ>O4*@E)OHJ%�2J<E+1[39~��RrHJ<=<E6�7=[5HJ%('*)?%32#@=H/@=9(6Z�68+-%3)?%325u `5+-%(+1%(+�6�+a@L7RL9()O>,'(�

{ )O2J43<=6 � W ©5u��*H1>?4*@=)?H1%�21<L+-[(9(7IBDH1<]7=6"%\@=6�%(Rr6^��W v

H-@E936"<EFQ),7N6�) 9(+J+a@=95+K7=6[+\FIHJ43>?'�9(+;:16]%(H^)O%5RrH1Z/)?%32#+1<ER1n\+K:P)OHJ>?+-@=)?H1%_H-B0R"H1%(7N@=<L+-)?%\@� y W�{ )?2143<E6 � W ©/7=93HaF]7 @E936C@�FIH�[eHJ7E7N)?`3>?6[(+-<L7N687IBDH1<G@=9(6^RrH1%57�@E<E+1)O%\@G21<L+-[39�W

XG936�<=6�+-<E6p7=)OZ/)?>?+1<=)O@=)?6�7�`e6r@�F 6"6�%^'*6"[e6"%('36"%(R"AS2J<E+1Z�Z_+1<E7�+-%5'i��+1%3)?%3)?+1%S2J<E+1Z�fZ_+-<]��� ���`e6�R�+-4(7=6Q7N4(RL9_R"H1%(7N@=<L+-)?%\@�2J<E+1[39(7�+1<=6Q+->,7=Hi[(<=H*'*4(R"6�'�`PA#'*6�[56�%('*6�%(RrA21<L+-Z/Z_+-<L7b� �IHa:P)O%321@=HJ%�n v ªJª � ��� "+J7N9(�16r@8n v ª # � �_��qY4('37=H1%�n v ª1ª1©\�rW���+-%3)?%3),+-%21<L+-Z/Z_+-<�'*)O�e6�<E7#BD<EH1Z @=936�Z )?%�@�F H�FG+;AP7�W { )O<L7�@8n�@=9(6d��+1%3)O%()?+1% BD<E+1Z/6"F H1<E�4(7=6�7K@=936d>?)O%32J43),7�@E)?R�)O%57N)?219\@#<E6"2\+-<L'*)?%32U�a+-<L+-�a+U<E6">,+a@=)?H1%57^@EH�),'*6"%\@=)OBDA <E6">,+a@=)?H1%57`e6r@�F 6"6"%dRrHJ%(7�@E)}@E436"%\@L7I)?%�+#7=6"%\@=6�%(Rr6JWp�P6�R"H1%('�n\@E936RrH1%57�@E<E+1)O%\@E7 +-<E6S7=4*��Rr)?6"%\@E>OA<E6�7N@=<E)?Rr@=6�'U@=9(+-@i@E936"AU<E6�'34(Rr6#@=H�FI6�>O>��P%3HaFQ%�`()O[(+1<N@E)}@E6#2J<E+1[39�Z_+a@LRL93)?%32b[3<EH1`3f>?6"Z_7 BDH1<GFQ93),RL9�6"��Rr)?6"%\@]7NHJ>O4*@E)OHJ%(7G+-<E6Y�P%3HaFQ%�W�XG93687N6CFQ)?>O>�`e6'*6�7ERr<E)?`568'b>,+a@E6"<8W

Page 103: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ������� ��% � � ��$&%V � � ���� !�� $&%V��$&%V��� � C� �� � �� � � $&%'� ª v�_ �� ���#�980� ���^!"�/� � ��T8P0]��� 8�!"� ��������0��'0]� � �����#�������

� !"� �� [(+1<E7=6iR�+-%d`56CHJ`*@E+1)O%368'�BD<EH1Z @=936^R"H1%(7N@=<L+-)?%\@ 2J<E+1[39b4(7=)?%32/)O%\@=6�216�< [(<=HJ21<L+-Z�fZ/)O%(2(W � RrH1%57�@E<E+1)O%\@�21<L+-[(9i),7�R"H1%P:16�<N@E6�'i)O%\@EH]+-%)?%J@E6"2J6"<�[3<EH12J<E+1Z/Z�)?%32G[3<EH1`3>?6"Z`PAU)O%\@E<=H*'*4(R")O%(2�+�:a+1<=),+-`3>?6^VUBDHJ<i+1%~+1<ER^BD<=HJZ�%(HP'36#) @=HV(Y>,+-`e6">?>O68'�`PAU�a+-<L+-�a+�U)?%�@E936�R"H1%(7N@=<L+-)?%\@S2J<E+1[39~7=4(RL9�@E9(+a@iBDH1<C6�:16"<EAU+-<LR@E936"<E6#),7C+b:a+1<=),+-`3>?61W^XG9(6:a+-<E)?+1`3>?6�7�@L+-�J6]@=9(6")?<I:a+->?43687I+J7 � H1< v W � [(+1<E7=6Y),7 +-%b+J7=7=)O2J%3Z/6"%\@IH1B v @EH^@=9(HJ7=6:a+-<E)?+1`3>?6�7#FQ93HJ7=6�R"H1<E<=687N[eH1%('3)O%32~+-<LR"7�+-<E6b)?%�@=9(6�[(+1<E7=6�7=43`*fl21<L+-[(9�np+-%(' � @EH@=9(HJ7=6]@=95+a@ +1<=6Y%3H-@8W�oIc\4(+->?)}@�A/+-%5'/)O%368c\4(+->?)}@�A_R"H1%(7N@=<L+-)?%\@E7�)?%�)?%J@E6"2J6"<t[(<=HJ21<L+-Z�fZ/)O%(2K[3<EH1`3>?6"Z R�+-%�`e6YHJ`*@E+1)O%368'/BD<EH1Z @=936CRrHJ%('*)O@=)?H1%(7i� � v n � z n*+-%('�� y ��>?)?7N@=68'6�+1<=>?)?6"<8nP+J7 BDH1>?>OHaF]7G<E6�7=[e6�Rk@E)O:J6">?A�uv W]{3H1<K6�+1RL9 '*6�Z_+-%(' 2J<=HJ43[s)�nmBDH1<#6�+JRL9hH1BQ)}@L7KZ_+-%5'3+a@EH1<EA��a+-<L+-�a+17C��n @=9(6BDH1>?>OHaFQ)?%32�6�c\4(+->?)O@=)?6�7GZK457�@]93HJ>?'�u

����� #u� ������� �� ��� v�]H-@E6p@E9(+a@������ Q7N@E+-%5'37mBDH1<m@=936 6�c\4(+-@=)?H1%^BDHJ<=Z/68'�na21)?:16�%K+Y'*6�Z_+-%('KFIHJ<E')+-%('/�a+-<L+-�a+C��W�XG9P4(7"nJ@=9(6"<E6]FQ)O>?>e`56i+17pZ_+1%\A�6�c\4(+-@=)?H1%(7t+17tR"H1Z#`3)O%5+a@=)?H1%57H-Bm)m+-%('���W

z W]{3H1<I6�+JRL9�'*6"Z_+-%5'_21<EH143[_) n\BDH1< 6�+JRL9_H-B�)O@E7IH1[*@E)OHJ%(+->eH1< '*6�7=)O<L+-`(>O6]�a+1<E+1�;+J7�enP@E936CBDH1>?>?HaFQ)O%32/)?%36�c\4(+1>O)O@=)?6�7GZ#4(7N@]93H1>,'�u� ��� �u ������� �� ��� v

y W]{3H1<Q68+1RL9�H-B @=936^7=H143<LRr6i21<EH14([(7#(rn3@=9(6CBDH1>?>OHaFQ)?%32�6�c\4(+->?)O@=)?6�7GZK457�@]93HJ>?'�u� � u� ��� � ��� ��

� � vXG9\457"nP@E936"<E6CFQ)O>?>�`e6^+17GZ_+-%PA�68cJ45+a@=)?H1%57Q+17 @=9(6"<E6C+1<=67=H143<LRr6iF H1<L'37"W

XG936tR"HJ7N@�BD43%(Rr@=)?H1%@EHQ`56IZ�)?%3)?Z/)���6�'),7�21)?:16�%^+17�@E936t7=43Z�H-B3+->?>-@E936p:a+-<E)?+1`3>?6�7�Wgh6i)?>?>O4(7N@=<L+a@E6i@=93),7Q`PA_BDH1<EZ/)O%(2#)?%36�c\4(+1>O)O@=)?6�7G6"@ER1W�BDH1<G@=9(66rV3+-Z/[3>?6i7=6"%\@E6"%(R"6��W v ��4(7N)?%32s{ )O2J43<=6 � W y �kWsXmH��16�6"[ @E936d%3H-@L+a@=)?H1%�RrH1Z/[(+JRk@8n�FI6�)O%\@=<EH*'*4(R"6�+-`3f`3<E6":P),+a@=)?H1%57GBDH1<]�a+1<E+1�;+J7G21)?:16�%d)?%�{ )O25W � W � W g~HJ<E'd21<EH14([(7Q)?%�7N6�%J@E6"%(R"6K��W v +-<E6<E6rBD6"<E<E6�'_@EH_`PA���+(n3`�n(R1n � �ku|!{��>�,{>{ �!{>{,�,�!{ � } �!}�z>{7{ ���;{>{,�;{>{`�;};� �A���7z� �!{ � � ��� }`|!{ � { � { }�{�� �{ | � �

Page 104: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

ª z ���������� � ��� �%$&%�$&��%�� � ���

��� �� � � � �(��� � � � �(� ���!�� v "+-<=@E+� z "+1<=Z_+� y "+-<L+-%(+{ )O2J43<=6 � W � u � `3`3<E6":P),+a@=)?H1%57 BDH1<G@=9(6�;+1<E+1�a+17

�IH1%57�@E<E+1)O%\@ � v 2J6"%36�<E+-@=6�7m@E936GBDH1>?>OHaFQ)?%32i6�c\4(+1>O)O@=)?6�7Q�DBDH1<�Z_+-%('(+a@=HJ<=A�a+1<E+1�;+J7� v +-%('�� z �ku��� � � u ��� � � � ��� ��� � � � �

� v��� � u ��� � � ��� ��� � � � � v

�IH1%57�@E<E+1)O%\@ � z 216"%(6"<L+a@=687"u� � � # u � � � # � �

� v{ )O%5+->?>OAJn*BDH1<�� y F 6i95+;:161u

� � u ��� � � � �� ��� � � �� v

� � u ��� � # � �� v

� � u ��� � � � �� ��� � � �� v

{3HJ<Q6�+J7N6CH-B <=68+1'3+1`3)?>O)O@�A1n*F 6C<=6�%(+-Z/6iV + 7Q+J7 BDH1>?>OHaF]7�u� � � � � �

�� �� � � � � �

��

��� � � � � � #��� � � � � � @� � � # � ��� D

�]HaFn*F 6C216"@� � � � u � � � �

� v��� � u � # � � @

� v� � � # u � D

� v� � u � � � � #

� v� �Qu � D

� v

Page 105: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ���7� ��% � � ���$&%" � � ��� �!�� $&%V� � �� ����$&%V�O��%� � � ��$ � % � � %V ª y� �Qu � � � @

� vXG936^R"HJ7N@ BD4(%(Rk@E)OHJ%�@EH/`56Z/)?%3)OZ/),7N68'�)?7�u

��������� � � � � � # � � @ � � D

$lB�FI67=H1>?:16i@=936^+1`5Ha:J61nPF 6i2J6r@Q@E936CBDH1>?>OHaFQ)?%32/7NHJ>O43@=)?H1%(7�u� �� v M � @

� v M � D� v

��7E+-Z/6+17G)?%U{ )O2J43<=6 � W ©e��+J�=�kn3+1%('� � v M � #

� v M � D� v

��7E+-Z/6+17G)?%U{ )O2J43<=6 � W ©e�D`5�=�kW

�_ N� ���#�980� ���^!"�/� � ��T8P0]� � 8�!"� � � �i�����U!"� � �^���� 8#8�!����!� 0Y���

gy)O@=9�@=936QR"H1%(7N@=<L+-)?%\@E7 � � v n � z +1%(' � y � 7N[e6�R")}T56�'�+-`eHa:161n;@E936G[(+-<L7=)O%32i[3<EH1`3>?6"Z<E6�'*4(R"6�7t@=H#`3)O[5+-<=@=)O@=6i21<L+-[39_Z_+a@LRL93)?%32#+1%('�+17E7=)O2J%3Z/6"%\@I[3<EH1`(>O6�Z/7�W�XG936�7=6Y9(+;:J66r��R")O6�%J@Y7=H1>?4*@E)OHJ%(7G6":J6"%d)O%d@=9(6FIHJ<E7N@GR�+17=61W{ )O<L7N@�n0>?6r@#4(7^RrHJ%(7=)?'*6�<^+URrHJ%(7�@E<E+1)O%\@21<L+-[(9~FQ93),RL9 '*HP6�7%(H-@^9(+;:J6/+1%PA�H1[3f@=)?H1%5+-> �;+1<E+1�a+3W�gh6dR�+-%�<E6�'34(Rr6_@E936�RrH1%57�@E<E+1)O%\@K2J<E+1[39s@=Hh+�`3)?[(+-<=@=)O@=6�21<L+-[390W{ )O%5'*)O%(2�+#7NHJ>O4*@E)OHJ%b2J<E+1[39/@=H#@=936CRrHJ%(7N@=<L+-)?%J@I21<L+-[39�<E6�'34(Rr687p@EHKT(%5'*)O%(2#+#Z/+-VPf)?Z/+1>�Z_+a@ERL9()O%32_)?%�@=936`3)?[(+1<N@E)}@E621<L+-[39�W��< ;<@? H�� ��J�� Q,D�� Q ��� D&L�GPB,Q�D&Q � BEGPL�N � GPQ �END ��� � � �*����� ���-� ��� ���*) �/� �Kn �^n oI� ),7]'*6"T(%36�'�+J7"u

�^u(7=6r@QH1B %3H*'*687�� �� � ������� � �#u(7N6"@QH-B�%3H*'*6�7�� �� � ������� ���oYu*6�'*2J6�7G`e6r@�F 6"6"% � +1%(' �#n(+-%5'���� � �

�mWXmH�[e6"<=BDH1<EZ @E936<=68'*4(Rr@=)?H1%�H-B @=936[(<=HJ`3>O6�Z H-B T(%('3)O%32�+/7=H1>?4*@=)?H1%�2J<E+1[39�@EHT(%('3)O%32~+�Z/+-@ERL93)?%325nmF 6/T(<L7�@KR"H1%(7N@=<E4(Rk@@E936�`3)?[(+1<N@E)}@E6�21<L+-[390WbXG936�`3)?[(+1<N@E)}@E621<L+-[(9b),7]RrHJ%(7�@E<=45Rk@=68'b)?%d@=93<E6"67N@E+1216�7�uv W]{3H1<Q6�:16�<=A�7=H143<LRr6i%3H*'*6^7G)?%d@=936^R"H1%(7N@=<L+-)?%\@G2J<E+1[39�n\BDH1<EZj+/%3H*'*67Q)?% �^Wz W]{3H1<Y6":16�<=Ad'*6"Z_+1%('�%3H*'*6K'U)?%�@=9(6#RrHJ%(7N@=<L+-)?%J@]2J<E+1[39U+-%('�6�:16�<=A�Z/+1%('3+-f@=H1<EA��a+-<L+-�a+_�U)?%�@E936#�a+1<E+1�;+�RL9(+-<=@YBDHJ<'�n�BDH1<EZ +b%3H*'*6�:U)?% �#W���XG9P4(7"nBDH1<Q6":J6"<EA_[(+-)?<^��'�n �3�I@=9(6"<E6i),7]+�%3H*'*6)?% �KW��

Page 106: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

ª-© ���������� � ��� �%$&%�$&��%�� � ���

y W]{3H1<b6":16�<=A 6�'*2J6 ��'�n 7L�/>?+1`56�>O>?6�' `PA��;+1<E+1�a+s� )?% @=936hRrH1%57�@E<E+1)O%\@_21<L+-[390nRr<E6�+a@E6i+1%�6�'*2J6i`e6r@�F 6"6�%�%(HP'36���'�n �3� )O% � @=H_7Q)?% �

{3HJ<I6"V3+-Z/[3>?61nJBDH1<I@=936CRrHJ%(7�@E<E+1)O%\@t2J<E+1[39_)?%�{ )O2J43<E6 � W y ��`34*@]+17E7N4(Z�)?%32@E9(+a@ @=9(6H1[3@=)?H1%(+1>*�;+1<E+1%(+]�a+1<E+1�;+S),7�Z/+1%('3+-@=H1<EA3��F 6G9(+;:16I@=9(6Q`3)O[5+-<=@=)O@=6G21<L+-[39#)O%_{ )?2143<E6� W � W

`(+JR"R�+1++���J6">,+1+ R��

9(+1+-@=9(+/7=6`��

�D�P9(+J+a@E+J+�936") n*�a+-<=@E+J�� n3� v�

�D�P9(+J+a@E+J+�936") n*�a+-<EZ/+\�� n3� z�

�D�P9(+J+a@E+J+�936") n*�a+-<L+-%(+\�� n3� y�

� v ��� W��-ª1ª � ª3n flª(W © � zJzPv �"� z*v ª3W � # �\z�y n f v � W�� z-z1z*v �r� v �[� W��-ª-ª � ª3n f ª3W ©+� z-z*v �r� z3v ª3W � # �1z;y n fl©1ª3W z;y #\z # �"� v �:� W �;ª1ª � ª*n f © � W © # #\z # �"� z*v ª3W � # �1z!y n f v � W

{ )?2143<E6 � W � uTW )O[5+-<=@=)O@=6C21<L+-[39�BDH1<]R"H1%(7N@=<L+-)?%\@ 2J<E+1[39d)O%U{ )O2J43<E6 � W y

� � ��� � ) � � � X H-BG+�`()O[(+1<N@E)}@E6/21<L+-[39�� � � � � �� �i),7+�7=43`(7=6r@^H1BI68'*21687FQ)O@=9�@=9(6[3<=HJ[56�<N@�A�@=9(+-@]%3H_6�'*2J6�7GH1B�X 7=9(+-<E6i@=936K7E+-Z/6C%3H*'*6JWIXG936Z_+a@LRL93)?%32[3<EH1`3>?6"Z�),7]@EH_T(%('�+ � � ��� � �(�5Z_+a@ERL9()O%32bH-B ��n(@E9(+a@i)?7�n�+�Z_+a@LRL93)O%(2�FQ)}@E9U@=9(6>,+-<E216�7N@�%P43ZK`e6"<�H1B\68'*21687"W � Z_+aV*)OZ_+1>-Z_+a@ERL9()O%32Q),7�R�+->?>O68'i+ � ��� � � ��-�0Z/+-@ERL93)?%325n)OB 6�:16"<EA_%3H*'*6)?% � +-%(' � 9(+17Q+1%�6�'*2J61WXG936�<=6C+-<E6Y@�F H/Z_+aV*)OZ_+1>�R"H1Z/[3>?6r@E6iZ_+-@ERL93)?%32J7 H1Bm@E936C21<L+-[39�)O%�{ )O2J43<=6 � W � WXG936�A�+-<E6�7=93HaFQ%�)?%�{ )O2J43<E6 � W��*WsXG9(6"A�RrHJ<=<E6�7=[eH1%('h@EH�@E936�[5+-<L7N687#7=93HaFQ%�)?%{ )O2J43<E6 � W ©5W

`(+JR"R�+1++���J6">,+1+ R��

9(+1+-@=9(+/7=6`��

�D�P9(+J+a@E+J+�936") n*�a+-<=@E+J�� n3� v�

�D�P9(+J+a@E+J+�936") n*�a+-<EZ/+\�� n3� z�

�D�P9(+J+a@E+J+�936") n*�a+-<L+-%(+\�� n3� y�

� v ��� W��-ª1ª � ª3n flª(W © � zJzPv �"� z*v ª3W � # �\z�y n f v � W�� z-z1z*v �r� v �[� W��-ª-ª � ª3n f�© � W © # #Jz # �r� z*v ª3W �%# �Jz�y n f ©Jª(W z�y%#1z # �r� v ��� W �aª1ª � ª(n f #*v W �:� © y � �"� z3v ª*W � # �\z�y n f # �

��+\�G�PH1>?4*@=)?H1%UR"H1<E<=687N[eH1%('(7p@EH_[(+-<L7N6i)?%�{ )?2143<E6 � W ©5��+J�

Page 107: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � ���7� ��% � � ���$&%" � � ��� �!�� $&%V� � �� ����$&%V�O��%� � � ��$ � % � � %V ª �

`(+JR"R�+1++���J6">,+1+ R��

9(+1+-@=9(+/7=6`��

�D�P9(+J+a@E+J+�936") n*�a+-<=@E+J�� n3� v�

�D�P9(+J+a@E+J+�936") n*�a+-<EZ/+\�� n3� z�

�D�P9(+J+a@E+J+�936") n*�a+-<L+-%(+\�� n3� y�

� v ��� W��-ª1ª � ª3n flª(W © � zJzPv �"� z*v ª3W � # �\z�y n f�©\ª*W z!y #Jz # �r� v �[� W��-ª-ª � ª3n f�© � W © # #Jz # �r� z*v ª3W �%# �Jz�y n f v � W�� zJz-z*v �r� v ��� W �aª1ª � ª(n f #*v W �:� © y � �"� z3v ª*W � # �\z�y n f # �

��`5�Q�PHJ>O4*@E)OHJ%URrH1<E<E6�7=[5HJ%('37t@=H_[(+1<E7=6S)?%U{ )O2J43<=6 � W ©e�D`5�

{ )O2J43<E6 � W �Pu#X�+aV*)OZ_+1>���RrHJZ/[3>O6"@=6;��Z_+a@ERL9()O%32\7�H-B�`3)?[(+-<=@=)O@=6Q2J<E+1[39�H-B�{m)?214(<=6 � W � W�]HaF F 6#7=93HaF @=95+a@YT5%('*)?%32d+bZ_+aV*)OZ_+1>0Z_+a@LRL93)O%(2b)?%~+�`()O[(+1<N@E)}@E6K2J<E+1[39U)?7@=9(6�7E+-Z/6b+17^T(%('*)?%32h+U[(+-<L7=6�)O%�+�RrHJ%(7�@E<E+1)O%\@K2J<E+1[39�W�.06r@VX `e6�+�Z_+aV*)OZ_+1>Z_+a@LRL93)O%(2UH-B]+�`3)?[(+-<=@=)O@=6�2J<E+1[39 ��W0$lBX ),7^RrHJZ�[(>O6"@=61n )O@#<E6"[3<E6�7=6"%\@E7+�[5+-<L7N6JWXG936�[(<=HPH-BG),76�+J7NAJW�{3HJ<K+-%s68'*216_`e6r@�F 6"6�%�+�%3H*'*6���'�n �3�C)?% �j+-%5'h+�%(HP'36��)?% �Kn0)O@^<=6�[3<E6�7=6"%\@E7i@E936�'*6"Z_+1%('~BDH1<^�a+-<L+-�a+���H1BI@E936b'*6�Z/+1%('h%3H*'*6�'h`56�)O%(27E+a@=),7NT(6�'~`PAU@=936�7=H14(<ER"6#%3H*'*6�7�W��P)?%(Rr6�+1>O>�@E936_%3H*'*6�7C)?% ��9(+;:16/6rV3+JRk@=>?AUH1%(66�'3216)?% X n3@E936^HJ<=)?21)?%(+->mRrH1%57�@E<E+1)O%\@ � v ),7Y7E+a@=),7NT(6�'�W]�P)?%(R"6K+->?>�@=9(6K%3H*'*687Q)O% �9(+;:J6Q6rV3+1Rr@=>?A#HJ%36]6�'3216])?%*X nPRrHJ%(7�@E<E+1)O%\@ � y ),7 7=+-@=),7�T(68'�WG� � %5'�7N)?%(R"6]@=9(6"<E6Y+-<E6%3H/H1[3@=)?H1%(+1>��;+1<E+1�a+17�n�� z ),7]7E+a@=),7NT(6�'b@=<E)O:P),+->?>OAJW �$lB�X ),7i%3H-@CRrHJZ�[(>O6"@=61ne@E9(+a@C)?7�n�)}@'*HP6�7i%3H1@S9(+;:J6K+-%~6�'*2J6KHJ%�+a@i>O68+17N@SH1%(6%3H*'*6�)?% � HJ< �Kn0@=936�% � '3H\687^%3H1@K9(+;:J6/+�[(+-<L7N6JWb$lB]+U%3H*'*6_)?% � '3H\687%3H1@9(+;:J6 +1%#68'*216Jn-)}@p),7p+i:P)OHJ>?+-@=)?H1%#H-BeR"H1%(7N@=<L+-)?%\@ � v n-H1@=936�<=FQ),7N6Jna)}@p),7p+i:P)OHJ>?+-@=)?H1%#H-BRrHJ%(7N@=<L+-)?%J@ � y W�XG936�<=6"BDH1<E61n�X|),7 %3H-@]+#[(+-<L7N6JW .06r@ @=936R�+-<L'*)O%5+->?)}@�A/H-BPX `e6CZdW

�I>?6�+-<E>?A�� ������� H1<�� ������� � �P)?%(Rr6"X ),7i+bZ_+aV*)OZ_+1>mZ_+a@LRL93)?%32(ne@=9(6"<E6#),7Y%(HZ_+a@LRL93)O%(2^H1% ��FQ)O@=9�>,+-<E216�<p%P43ZK`e6"<IH-B�68'*21687"W�XG936"<E6rBDHJ<=6JnJ+1%\A�H-@E936"<IZ_+aV*)OZ_+1>Z_+a@LRL93)O%(2b�DFQ93),RL9�Z/)?219\@ RL93HPH\7N6]+#'*)}��6"<E6"%\@I7=6r@ H-B�68'*21687E��FQ)?>?>eR"Ha:16"<t6rV3+1Rr@=>?A#Z%3H*'*687Y)?% � +-%('�Z %3H*'*6�7S)?% �KW �IHJ%(7N68c\436"%\@=>?A1n�7=H1Z/6K%3H*'*6�)?% � H1< � F H143>,'+-2\+-)?%/%3H-@ 9(+;:16]+1%�6�'*2J61W�XG9P4(7"nP+-%PA�H-@E936"<IZ/+-V*)OZ_+->5Z_+a@ERL9()O%32KFIHJ43>?'_+1>?7=H%3H1@21)?:16C4(7Q+�[(+1<E7=61WXG936RrHJ%P:16"<L7=6S9(+J7G`56�6"%�>?6rB @Y+17Q+1%�6"V*6"<LRr),7N6JWXmH T(%(' +�Z/+-V*)OZ_+->SZ_+a@ERL9()O%32 H-B^+ `3)?[(+-<=@=)O@=6~21<L+-[390nI@E936"<E6�),7�@E936�F 6">?>Of�P%3HaFQ%�+-432JZ�6�%\@=)?%32/[(+a@E9�+1>O2JH1<E)}@E93Z�WQ���P6�6^��+-[(+J'*)OZ/)O@=<EH14h� v ª #Jz �tHJ< � 9P4:(N+/6"@+-> W]� v ª1ª y �pBDH1<]+/'*6�7ERr<E)?[*@=)?H1%�W��_�� �0� ¥ � � � ��¥ � ��£ �;�'&m� �L¤  k�k��� � � × � � � � � �¤× ( � � � ��� � � ×Q¥ ��� × ( ¤�¥2, � � � �L�� �� � ���'��� � !�� �1����0¢ � � ¥ �C�k� ×]� ,�� � & ( � �k¢ ¤�¥p× ��� � ( �N���L� � � �1� � � � ( ������� ��!.! *0��� ¥ � ¥ �1�;� � ���k�� � � ¥�¤ �3� � �i¢ ¥� � � ��� ¥ �Y�)� � ��� ¤ ��� ¥=� � � � ×Q¥ �k�i�� × ¢ ¥ ���L�3�;�� ¥ � � �1� ¥ �;  ¥ � *

Page 108: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

ª � ���������� � ��� �%$&%�$&��%�� � ���

��< ;<>= H�� ��J�� Q,D�� Q ���KR R D� �� � Q�� B � � ����$&%�@E936/>?+J7�@7=6�Rk@E)OHJ%�n�FI6/7E+;F @=9(+-@C)OBI+1>O>�H14(<S�a+-<L+-�a+J7S+1<=6#Z/+1%('3+-@=H1<EA��a+-<L+-�a+17�n@=9(6i[(<=HJ`3>O6�Z H-BmT(%('*)?%32_+�[(+-<L7=6S<E6�'*45Rr6�7I@EH#T5%('*)?%32_+#Z_+-VP)?Z_+->�Z_+a@LRL93)?%32#)?%�+`3)?[(+-<=@=)O@=62J<E+1[39�W$lB�FI6Q[e6"<EZ/)}@pHJ[*@=)?H1%(+1>*�a+-<L+-�a+17�na@=9(6Q[3<=HJ`3>?6"Z 7N@=)?>?>39(+17t+-%�6r��Rr)?6"%\@I7=H1>?4*@=)?H1%0W$l@Q%3HaF <E6�'*45Rr6�7I@EH#T5%('*)?%32_+KZ_+a@LRL93)?%32#FQ9()?RL9d9(+17I@E936CZ/+-V*)OZ_+->�F 6")?219\@G)O%�@=9(6F 6")?219\@=68'�Z_+-@ERL93)?%32/[3<EH1`3>?6"Z�WIXmH_[e6"<=BDH1<EZ @=9(6^<=68'*4(Rr@=)?H1%�n3F 6%36�6�'�@=H/BDHJ<=Z�+F 6")?219\@=68'#`()O[(+1<N@E)}@E6Q21<L+-[390W0gh6QT(<L7�@�BDHJ<=Z +C`3)O[5+-<=@=)O@=6Q21<L+-[(9#6"V*+JRk@E>OA�+17�`e6rBDH1<E61W�]6"VP@t@=9(6Y6�'3216�7I+-<E6QFI6�)O2J9\@=6�'/`PA/+17E7N)?21%()O%32^+^FI6�)O2J9J@IH-B v )OB�@=936S6�'*2J6]),7�BD<EH1Z�+%3H*'*6^)?% � <E6"[(<=687N6�%J@E)O%(2/+�Z/+1%('3+-@=H1<EAb�a+1<E+1�;+_+1%(' � )OBpH1[*@E)OHJ%(+->��a+1<E+1�;+(W XG9(6[3<EH1`3>?6"Zx%3HaFj),7/@EHsT(%('�@=936�Z/+-V*)OZ_+->QZ_+-@ERL93)?%32 �DHJ<�+17E7N)?21%(Z�6�%\@L�K@=9(+-@b9(+J7@=9(6#Z_+aV*)?ZK43Z F 6")?219\@_��R�+->?>O68'U@=9(6 � � �!� � � �� � �(�������-� � ��� � ) � � ��[3<EH1`3>?6"Z HJ<�"� ��� � � � � � �I[3<EH1`(>O6�Z_�rW~XG936�<=687N4(>}@E)O%32~Z_+a@ERL9()O%32�<=6�[3<=687N6�%\@E7K+�:a+->?)?' [5+-<L7N6�)OB@=9(6_Z/+-@ERL93)?%32�R"Ha:16"<L7C+->?>�%3H*'*6�7^)O% � +-%5'hR"Ha:16�<E7S@=9(HJ7=6_%3H*'*6�7C)?% ��@=9(+-@K+-<E6BDH1</Z_+-%5'3+a@EH1<EA~�a+-<L+-�a+J7"Wy��XG9(6dZ_+-VP)?Z_+-> FI6�)O2J9\@/R"H1%('*)O@=)?H1%�6"%(7=43<E6�7K@=9(+-@/+1>O>6�'3216�7tBD<EH1Z %3H*'*687I)?% � <E6"[3<E6�7=6"%\@E)O%32KZ/+1%('3+-@=H1<EA/�a+-<L+-�a+17I+-<E6S7=6">?6�Rk@E6�'�T(<E7N@�n*)OB[eHJ7E7N)?`3>?61W��KXG93),7 [3<EH1`3>?6"Z�9(+J7I+#�P%3HaFQ%b7=H1>?4*@=)?H1%�`PA�@=9(6iqY43%32J+1<=),+-%bZ�6"@=93H*'bH-B@=)?Z/6^RrHJZ�[(>O6"VP)O@�A � ��� #8�G+1<=)O@=93Z/6"@=),RCH1[e6"<L+a@=)?H1%57i� "C4393%�n v ª � � �rW

�]H1@=6Q@E9(+a@I)O%_@E936S+1`5Ha:J6 @=936�H1<EA#F 6]9(+;:J6QZ/+J'*6Q@E936]BDHJ>O>?HaFQ)O%(2^+17E7N43Z/[*@E)OHJ%(7�u��+\�0oI+1RL9^F H1<L'2J<=HJ43[^),7m4(%3)?c\436�>OA),'*6�%J@E)}Te+-`3>?6G`56"BDH1<E6p@=9(6GR"H1<E6t[(+1<E7=6"<m6rV*6�R"4*@=687"n�D`e�KoI+1RL9 '*6"Z_+1%(' F H1<L's9(+17KH1%3>?AsH1%36��a+1<E+1�;+URL95+-<=@�n�+-%(' ��R��KXG936"<E6�+1<=6_%(H+-Z#`3)?2143)O@=)?6�7�`e6r@�F 6"6"%w7NHJ43<LRr6dFIHJ<E'�+1%(' '36"Z_+-%('�F H1<L'�W�opZ/[3)?<=),R"+1>Q'3+a@L+�BDHJ<$&%('*),+-%h>,+-%32J4(+-2J6�7C7N9(HaF]7Y@E9(+a@8nmR"H1%('*)O@=)?H1%57_��+J�C+1%('w�D`5�C9(H1>,'�W �IH1%('*)O@=)?H1% ��R8�kn93HaF 6":J6"<8n0'*HP6�7%(H-@K+->?FG+;AP7i93HJ>?'hBDHJ<^Rr6�<N@L+-)?%h$&%5'*)?+1%s>?+1%3214(+121687"n0+J7^7=93HaFQ%~`PA+dRrH1<E[34(7�WKot:16"%�@=93HJ43219~@=9(6"<E6�+1<=6�Z_+-%PAU6rV3Rr6�[*@=)?H1%57Y@EHb@E93),7RrH1%5'*)}@E)OHJ%�n�@E936"A7N@=)?>O>*[3<EH*'*4(R"6 HJ%3>?AK+ � � �(���;%P43Z#`56�<�H-Be7=4(RL9�+-ZK`()O2J43)}@E)O687�H1<�Rr>,+17=93687"W XG936"<E6rBDHJ<=6JnBDH1<C68+1RL9�[eHJ7E7N)?`3>?6�'36"Z_+-%('�21<EH143[~+-%('~7NHJ43<ER"6K2J<=HJ43[�Rr>,+17=9�n�+�%36"F R"H1%(7N@=<L+-)?%\@21<L+-[(9/R�+-%_`e6][3<EH*'*4(Rr68'_+-%('_7=H1>?:168'�n1>?6�+;:P)?%32C@=9(6][5HJ>OAP%3HJZ/)?+1>3@=)?Z/6SR"H1Z/[3>?6rV*)}@�A43%(RL95+-%32J6�'�W

�_ �� � �T0���0]�T0Y��� 08�� �V0Y� � ��T8P0�8ghH1<E>?'�P%3HaFQ>?6�'3216tR�+-%^+->,7=H]`56 4(7=6�'^'343<=)?%32S[(+-<L7N)?%325W W 4*@0@E936 c\43687�@E)OHJ%^),7"n;FQ9(+-@�P)O%5'�H1B�FIHJ<=>,'b�P%3HaFQ>?6�'32167N9(H143>,'d`56^457N68'��~�*4(RL9��\%(HaFQ>O68'*216C6rV*[3>?H*'*6�7])O%U7=)���6:16�<=AKB�+17N@�nP+-%('�)?7I'*)}��R"43>}@I@=H#4(7N6S'*43<E)O%32K[(+-<L7N)?%32���H1<t[(<=H*Rr687=7=)?%32\�rW � %36i+-%(7=FI6�<),7K@EH~457N6d7N6�Z/+1%\@=),R�@�AP[e6�7�H-B]T5>O>?6"<L7KH1BY�a+-<L+-�a+�<EH1>?6�7�n�`34*@/@=Hh>?)OZ/)O@/)O@�@=H~@=9(+-@%368Rr6�7E7E+-<EAUBDH1<^<E6"Z/Ha:P)?%32U+-ZK`()O2J43)}@�AJnm)OB]+-%PA1n )?% �;+1<E+1�a+d+J7=7=)?21%3Z/6"%\@8W�$&% H1@=936�<F H1<L'37"nIBDH1<�+ 21)?:16�%w:J6"<E`�n FQ936"%y�a+-<L+-�a+-f :P)?`39(+-�\@E)QZ/+1[3[3)?%32�),7_%3H1@�7N43�_R")O6�%\@BDH1<_[(<=H*'*4(R")O%(2s+1%�4(%(+-Z#`3)O2J43H1457/[(+-<L7N6JnI7=6"Z_+-%\@E)?R�@�AP[5687_+-<E6�)O%(R">O45'*6�'�W XG9(67=6"Z_+-%\@=),R @�AP[5687p7=H)O%(R">O45'*6�'/9(+;:J6 @=936]7=H1>?6rfl[343<E[5H\7N6GH1Be�a+-<L+-�a+C'*),7=+1ZK`3)?2145+a@=)?H1%0WXG93),7��16"6�[(7K@=936d%P43ZK`e6"</H-Bi7N6�Z/+1%\@=),R_@�AP[5687�43%('*6�</R"H1%\@=<EH1> n�+-%('�7N6�<=:J6�7#+17�+214()?'*)?%32U[39()O>?HJ7=H1[39PAUBDHJ<FQ9(+a@K7=6"Z_+1%J@E)?R#@�AP[e6�7C@EHU)O%(R">O45'*61Wd{m)?214(<=6 � W # 7N9(HaF]7

Page 109: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� � �� �� ���� �� %V���=� �?���� C� � ����� ª �@=9(6^7�@L+-<=@=)?%32�7=6"Z_+1%J@E)?RS@�AP[e693)O6�<E+1<ERL9PA_FQ93),RL9d)?7Q7=4*��Rr)?6"%\@QBDH1<]+�Z_+:(�HJ<G[(+-<=@QH-B>,+-%32J4(+-2J61W

9P43Z_+-% %3H1%*fl9P43Z_+-%� �!y W � � � ª3n � � W ª � � � �r� v ©5W # �(v-v � n � �r� �!y W � � � ª3n � � W ª � �[� �r� #Jz W � � # © z n � �

+-%3)?Z_+a@E6)?%(+1%3)OZ_+-@=6� # ª3W � � ©(n � � W ª � �[� �r� �!y W � � � ª v n � �"� # ª(W � � ©(n � � W ª � ��� �"� v � �PW © �3v8z ª3n � �

X

{ )?2143<E6 � W # up�P6"Z_+1%J@E)?Ri@�AP[e693)?6"<L+-<LRL9\A

�PHJZ�6"@=)?Z/6�7pF 6]9(+;:J6YRrHJ%(7N@=<L+-)?%J@L7�FQ93),RL9�%3HJ<=Z_+->?>?AK93HJ>?'_`(4*@ 7=H1Z/6r@E)OZ/687tR"+1%`e6tHa:16�<Nfl<E)?'3'36"%�W�XG93687N6I[3<E6rBD6"<E6"%5Rr6tR"H1%(7N@=<L+-)?%\@E70R�+-%`e6I457N68'C@=HSH1<L'*6"<�@E936t[5+-<L7N687[3<EH*'*4(Rr68'�`PA_@E936C[(+-<L7N6�<�W $lBmF 6C'*H�7=H(nPF 67N6�6Y@E93HJ7=6S[5+-<L7N687tT5<E7N@ FQ9()?RL9d7=+-@=),7�BDA@=9(6t[3<E6rBD6�<=6�%(Rr6pR"H1%(7N@=<L+-)?%\@�W0qYHaFI6�:16"<8n")OB(+G[(+1<E7=6p'*HP6�70%3H-@m7E+a@E)?7NBDAS@=936I[3<=6"BD6"<E6"%(R"6RrHJ%(7N@=<L+-)?%J@L7"nP)O@])?7Y7�@E)O>?>�[3<EH*'*4(Rr68'�n*`34*@]HJ%3>?A�>?+-@=6�<�W�p<E6rBD6�<=6�%(Rr687KHa:J6"<�[(+-<L7=6�7/R"+1%�`e6�7N[e6�R")}T56�'�`\A�7N43)O@E+1`3>?A�:a+-<EA\)?%32~@=936�R"HJ7N@BD43%(Rr@=)?H1%~)O%U@E936K)?%\@=6�216"<S[3<EH121<L+-Z/Z/)?%32_[3<EH1`3>?6"Z�WY$lBpF 6K457N6�7N4(RL9~+�RrH\7�@SBD43%(Rkf@=)?H1%0n3FI6CFQ)?>O>0216r@Y+�[(+1<E7=6S@=9(+-@]9(+17Q+/Z/)?%3)OZ#43Z R"HJ7N@QFQ)}@E9d<E6�7=[e6�Rk@Q@EH�@=936KR"HJ7N@BD43%(Rr@=)?H1%�W�XG9(6�)?%\@=6�216"<C[3<EH12J<E+1Z/Z�)?%32�7NA*7N@=6�Z R"+1%~`e6_7NHU7=6r@43[h@=9(+-@^FI6/R"+1%+17=�/BDH1<I@=9(6i%(6rVP@]7NHJ>O4*@E)OHJ%�nP)O%�FQ93),RL9dR�+17=61nPFI6SFQ)O>?>�216"@G+1%3H-@E936"<G[(+1<E7=6YFQ)O@=9�@=9(67E+-Z/6]H1<I93)?21936�<IRrH\7�@8W XG9()?7 R"+1%_`56S<=6�[568+a@=68'�@=H#H1`*@L+-)?%�+->?>3@=9(6Y[eHJ7E7N)?`3>?6][(+-<L7=6�7�W�PHJZ�6 <E6�+17=H1%5+-`3>?6p[3<E6rBD6�<=6�%(Rr6870FQ93),RL9#R�+-%#`56G)?%(RrHJ<=[eH1<L+a@E6�')?%^@E936QRrHJ7N@ BD43%(Rkf@=)?H1%U+1<=6C+17 BDHJ>O>?HaF]7"u � >O>�6�>?7=6C`56�)O%(2_6�c\4(+-> nv W�"+-<=@E+S9(+17m@=9(6GBDH1>?>OHaFQ)?%32C[3<E6rBD6"<E6"%5Rr6�7 )?%_'*6�7ERr6�%('*)?%32CH1<L'*6"<8u�9P43Z_+-%�nJ%3H1%3f9\4(Z/+1%�n*)?%(+-%3)?Z_+a@E6/��+-%3)?Z_+1R"Ab[3<E6rBD6�<=6�%(Rr6;�kWz W � 7NHJ43<ER"6�21<EH143[w)?7bRr>?HJ7=6�@=Hs@=9(6�'*6"Z_+-%5'�2J<=HJ43[wFQ)}@E9yFQ93)?RL9 )O@b9(+J7_+<=6�>?+-@=)?H1%(7=93)?[�WQ��Rr>?HJ7=6"%(6�7E7I[(<=6"BD6"<E6"%(R"68�y W�"+-<=@E+#HPR�Rr43<L7 `56"BDH1<E6�a+-<EZ/+#)?%�+/7=6"%\@=6�%(Rr6_��>O6"B @=%3687=7Y[3<=6"BD6"<E6"%(R"68�rW

XmH^@=9(6i+1`5Ha:J6Y>?)?7N@GR�+-%�`e6C+1'3'*68'�+#93HJ7N@IH1BmRrHJ%('*)O@=)?H1%(7 '*6�+1>O)?%32#FQ)}@E9�+-%5+-[393HJ<E+(nZ/Ha:16�Z�6�%\@�n*2J+1<E'36"%*fl[(+a@E9�7=6"%\@=6�%(Rr687"n*6"@ER1W

Page 110: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

ª # ���������� � ��� �%$&%�$&��%�� � ���

�_ �� � �*8 � �^� ��� �� ��8 �-�K� �*0Y�98P0 � !]8 ��� 2U!���� � ���!r�#�

XG936U7=6�RrHJ%('�Z_+�(�H1<�@E+J7N�s@EHh`e6U+1R�RrH1Z/[3>?),7N9368'�`PA @E936URrH1<E6d[(+-<L7N6�<#),7_'*),7=+1Z�f`3)?214(+-@=)?H1%~H-BtF H1<L'�7=6"%(7=6�7�W^XG93),7S<E6�c\43)?<E6�7Y@=936�[3<E6"[(+1<E+-@=)?H1%�H1Bt>?+1�*7N9(+1%�RL9(+1<N@L7�DHJ<]'*),7=R"<=)?Z/)O%(+-@=)?H1%d%36r@L7E�IBDHJ<Q%3H14(%(7Q+-%('d:J6"<E`(7"W� >,+-�*7N95+-%sRL9(+-<=@BDH1<^+�:J6"<E`s+1>O>?HaF]7C4(7C@EHU)?'36"%\@=)OBDA�@E936�7=6"%(7=6_H-B @=936b:16"<E`)?%s+U7=6"%\@E6"%(R"6_21)?:16"%h)O@E7[(+1<E7=61W�.m+-�*7=9(+-%sRL9(+-<=@E7CZ_+1�16/4(7=6_H-B @=936��a+1<E+1�;+J7iH-B@=9(6�:J6"<E`�)?%�@=9(6/7=6"%\@E6"%(R"61neBDH1<'*6"@=6"<EZ/)O%()O%32�@=9(6#:J6"<E`~7=6"%(7=61W^{(H1<i6rV3+-Z/[3>?61n�)?%7=6"%\@=6�%(Rr687��(W v +1%('��(W z @=9(6^:16�<=` ) (�H-@L+a@E+J+/936")S+(),7]457N68'�)O%�@�F Hb'*)O�e6�<=6�%\@S7N6�%(7=6�7�u[3>?H1432J9d+1%('�+a@=@E+1RL90W

� � � � � {7{ � {`����}7�;{`��� �>�,�;{��;{>{ �;};� � {,�A��}7� z>{ � � � ��� � z>��� � � ���� �;} � {,�A� },� � z>��� � � � �7�;} z7{ � � ��

� � � � � {7{ � { � {7{��!�>� �!� �>�,�;{��;{>{ �;};� � {,�A��}7� �7{��>� � �!��{,�>�;{>�A�;}��� �;} � {,�A� },� {,�>�;{��.�;} � �7�;} �7{,�>� �

� CB � � � {7{ � {`����}7�;{`��� ��{>{ � {,�;{>{��;};� � {,�A��}7� ����� ����� ��� �!{,� � } � � ���� �;} � {,�A� },���!{,� � } � � � �7�;} ���;� ��� ��

.0+1�*7N9(+1%~RL9(+1<N@iBDH1<") (�H-@L+,+�FIHJ43>,'~+1>O>?HaF 4(7i@=HU7=6">?6�Rr@i@E936_+-[3[(<=HJ[3<=),+a@E6#7=6"%(7=6�H-B(�H-@L+/`PA�@=687�@E)O%(2_FQ936r@E936"<])O@E7Y�a+-<EZ/+�),7Q>,+-%('dH1<]R�+-<=@]6r@LR-W � 2J+1)O%�n()}@]),7Y'*687N)?21%(6�'BD<EH1Z|+-%�)O%*BDHJ<=Z_+-@=)?H1%U@E936"HJ<=6"@=),RK[eH1)?%\@iH1Bt:P)O6�FWCXG9(6�+;:a+-)?>,+-`3>?6K)?%*BDH1<EZ_+a@E)OHJ%�)?74(7=6�'�)O%s+-%~6�RrHJ%3H1Z/),R"+1> +1%('�6"�_R")O6�%\@iZ_+-%(%36"<C)?%~'*68'*4(Rr)?%32�@=936/<E)O2J9\@C+1Z�HJ43%\@H-B�%36�F )?%*BDH1<EZ_+a@=)?H1%0W

� :16�<=`�>,+-�*7=9(+-%hRL9(+-<=@iBDH1<+b:J6"<E`�),7C[3<E6"[(+1<=68'U`PA�>O)?%32J43)?7N@E7C+1%('�>,+-%(214(+12166rV*[e6"<=@E7Q`PA�>OHPH1�P)?%32/43[U'*)O�e6�<=6�%J@Y7=6"%57N687GH-B @=936^:J6"<E`�FQ)O@=9�@E936936�>O[UH1B�R"H1%P:16�%*f@=)?H1%5+->G'*)?Rr@=)?H1%(+1<=)?6�7�WsXG936dRL95+-<=@#`343)?>,'*6"<�ZK4(7N@_R"+-<E6rBD4(>O>?A 7N6�>O68Rk@�BD6�+a@E43<E6�7K@=9(+-@F H143>,'�+1>O>?HaF :J6"<E`�7=6"%(7=6i@=H_`e6H1`*@L+-)?%36�'�W�]HJ43%h>?+1�P7=9(+1%~RL9(+1<N@L7Y936�>O[ '*),7E+-ZK`()O2J4(+a@E6�7=6"%(7=6�7iH1BI%3HJ43%(7C)?%h+d7N6�%\@=6"%5Rr61WXG936�AdZ_+1�16^4(7=6KH1B�@=936�[(+1<E7=6K7N@=<E4(Rk@E43<=6��D) W 6JWOn��a+-<L+-�a+/<E6">,+a@E)OHJ%(7E�Y+-%('d@E936�:16"<E`7=6"%(7=61W�{3HJ<t6rV3+1Z�[(>O6JnJ)?%b7=6"%\@=6�%(Rr687��5W v +1%('��5W y n1@E936S7=6"%57N6]H1B��P936r@L+)?7I>,+-%('_+1%('Rr<EH1[0n*<=687N[e6�Rr@=)?:16">?A1W�qYHaFI6�:16"<8nP'*6"[e6"%('3)O%32_HJ%d@=936:J6"<E`bH-B�FQ93),RL9�)O@]),7]+��;+1<=Z_+(n@=9(6^+-[3[3<EH1[(<=),+a@E6i7=6"%(7=6C)?7Q7=6">?6�Rr@=68'�W�p<E6"[5+-<L+a@=)?H1%bH-B�>?+1�*7N9(+1%dRL95+-<=@E7G),7]+/>?+1`5HJ<=)?H1457I[(<=H*Rr687=7G`(4*@Y),7Q6�7E7N6�%\@=),+->�BDHJ<Z_+1RL93)?%36S@=<L+-%(7=>,+a@=)?H1%0W�.0)O%(2143),7�@E)?RY@=9(6"H1<E)?6�7G+-<E6S2J6"%36�<E+1>O>?A_7N)?>?6"%\@QH1%�@=936C),7=7=436iH-BF H1<L'b7=6"%(7=6^'*),7=+1ZK`3)?214(+-@=)?H1%�W

Page 111: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� �n��! � � � �� ªJª�_ �� ���!� � �� �XG936U��+-%()O%3),+-% BD<E+1Z/6"F H1<E�~@E43<E%(7�H14*@/@=Hs`e6�6">?6"2J+1%\@/+J7#F 6">?>]+17�%(+-@=43<L+->Q+1%('6r��R")O6�%J@8W$l@i),7i6">?6"2\+-%\@S`e6�R�+-4(7=6K)O@i),7C+-`3>?6#@=Hd9(+-%('3>O6�'*)O:J6"<L7N6#[3936�%3H1Z/6"%5+�>?)O�J6�a+-<L+-�a+b+J7=7=)?21%3Z/6"%\@8n�+1Rk@E)O:J6rfl[(+17E7=)O:J6�7�ne+1%('~R"H1%\@=<EH1> )?%h+�43%3)OT(6�'~Z_+-%3%(6"<8WK$l@)?76r��R")O6�%J@I`568R"+-457N6Q@E936YR"H1%(7N@=<L+-)?%\@p[(+-<L7N6�<pFQ93),RL9�+-<E)?7=6�7p:16"<EAK%5+a@=4(<E+1>O>?AK4(7=)?%32@=9(6BD<L+-Z/6"F H1<E�_)?7G6"VP@=<E6"Z/6">?A_B�+17N@�W

� JB�Q,N�� B H�� G��D��

XG936i[(+-<L7=)O%32/7ERL936"Z/6i`\Ab)O%\@=6�216�< [(<=HJ21<L+-Z/Z/)O%32�'*6�7ERr<E)?`568'�936�<=6CFG+17 6�+1<=>?)O6�<'*),7=R"4(7E7N68' )O%�WI95+-<L+a@=)S6r@�+-> Wj� v ª1ª � �kW1U]6�'*4(Rr@=)?H1%y@EH Z_+a@LRL93)?%32�[3<EH1`3>?6"Z )?%`3)?[(+-<=@=)O@=62J<E+1[39b),7Q'*),7=R"4(7E7N68'�)?%9WI95+-<L+a@=)�6"@Y+-> WQ� v ªJª y +J�kW{3HJ<]BD43<=@=9(6"<C'*6r@L+-)?>?7iH1%~RrH1Z/[3>?6rV*)O@�Ad+1%(+->?A*7N),7]H1Bt[(+1<E7=)O%(2b+->?21HJ<=)O@=93Z_7QH1Bp@=9(6RrHJ%(7N@=<L+-)?%J@p[5+-<L7N6�<p'*6�7ERr<E)O`e6�'/9(6"<E6]7N6�6Y��6"<E<E+�(�4d� v ªJª z �rW#U]+;:P),7=+1%3�a+-<]� v ª1ª v � '*),7�fRr457=7=6�7G'*)O�e6�<=6�%\@ FG+;A*7p@E9(+a@ @=936C)?%\@=6"2J6"< [3<EH121<L+-Z/Z/)?%32K[3<EH1`(>O6�Z�R�+-%�`56iBDH1<EZK43f>,+a@=68'd@=H_HJ`*@E+1)O%U:a+-<E)?H14(7G[(+1<E7=6�7G)?%U[3<E6rBD6�<=6�%J@E)?+1>�H1<L'*6�<�W�WI95+-<L+a@=)�6"@S+-> WC� v ªJª � +J�'*),7=R"4(7E7�<E6">,+a@E)OHJ%(7=93)O[ `56"@�FI6�6"% �Y.0��nQR"H1Z/[3>?6rV*)}@�A @E936"HJ<=Ay+1%(' Z_+a@E936"Z_+-@=),R"+->>?H121),R-W �� � B�� D@R�� R

� ��� �P93HaF @=936_RrHJ%(7N@=<L+-)?%J@i21<L+-[39~+-%('~7NHJ>O4*@E)OHJ%�21<L+-[(90��7L�QBDHJ<S68+1RL9~H-Bp@E936KBDHJ>}f>?HaFQ)O%32_7=6"%\@=6�%(Rr687G)O%�q])?%('*) u�;{>{P� { � �!{>z7{ ���!{7{A��{,�;{ �����;{ � { ��� |>�!z>{>{��;{>{c�;}�� !{P� � �7���A� �!{ � � ���;� }>{,��} � �!���;{ � � ��� �7{>z>z � � ���� { � � ��� }�{,�>} � � �7�!��� � !{2� �7{>z>z � �!���!{ � ��

�;{>{P� { � } � �;{>z>{ �!{>{ � {A�!{,�;{ ���;{>{,�;{>{ !{P� � } � �,����� �;{ � � ����� �A��� {,�>}� !{P�n{,��} �!{ � � ��� �A�>���7�;} � �7����� �

� �!{>z7{ ��{>{ � { � }c�;} z�����} � � { � } �7{>{A���7� z����;{7{ � �7���A� �;� � �A��� � �;} � z����>}��;} ��� } � � � � } �;�>�A���� � �.��� � �7�!��� � �;} �;�>�A� { � � � � } ��

� ��� �P93HaF @=936_RrHJ%(7N@=<L+-)?%J@i21<L+-[39~+-%('~7NHJ>O4*@E)OHJ%�21<L+-[(90��7L�QBDHJ<S68+1RL9~H-Bp@E936KBDHJ>}f>?HaFQ)O%32_7=6"%\@=6�%(Rr687G)O%�q])?%('*) u� ���.�!{>{,�!�>� � }c|>�!{7{ � {>{,�>} �7�;} � ��}7�;{ �!����}����;{>{ �>� � �>}7� ��� }��>���7z,} � �7� �7� � ��� z��,� � � �!� � {���� �;} �>� � ��},� � {� { z��7� � �7���7z7}��7� �>� � ��� ��

�;{>{P� { � } �!{7{,�7�!{ � } �A�!�>�7zA��{��;{ �!}�z7{>{ ���;{>{,��}��>��} !{P� ��� } �!{ � � ����� } �!{ � � ���;��� }7}�z7}-� |!{ � { � {�}�{��!� ���

Page 112: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v � � ���������� � ��� �%$&%�$&��%�� � ���

|!{ � ��{,�;{ �����>}����!{>{ ��� � �;}7� � ��� � {�� !{P� � {� { � � � �!}7��}�{,�!� �>� { |!{ � { � { �!{ � � ����� }7}�z7}-� ���������7���� � �;{ � � ��

� ��� {3HJ<=Z )?%\@=6�216"<G[3<EH12J<E+1Z/Z�)?%32^[(<=HJ`3>O6�Z�BDH1< @=9(6C7=6"%\@E6"%(R"6�7 )O%�o�V*6�<ER")?7=6 � W v W� � � {3HJ<=Z )?%\@=6�216"<G[3<EH12J<E+1Z/Z�)?%32^[(<=HJ`3>O6�Z�BDH1< @=9(6C7=6"%\@E6"%(R"6�7 )O%�o�V*6�<ER")?7=6 � W z W� ��! �p<EHa:16b@=936UR"H1%P:16�<E7=6~��H-BY@E936d@=936�H1<E6"Z [3<EHa:168'�)?% �*6�R-W � W ©(W v �^@=9(+-@_)}BC+RrHJ%(7N@=<L+-)?%J@ 21<L+-[39~�DFQ)O@=9d%3H#HJ[*@=)?H1%5+->��a+-<L+-�a+J�p9(+17G+#[(+-<L7N6Jn1@E936"<E6C)?7G+#Z_+aV*)OZ_+1>Z_+a@LRL93)O%(2�RrHa:16�<=)?%32U+->?>�@E936�%3H*'*687)O% )O@E7K`3)?[(+-<=@=)O@=6�2J<E+1[39�n +-%('h)OB])}@#'3H\687%3H1@9(+;:J6/+�[(+-<L7N6�@E936"<E6_)?7K%3HUZ_+a@LRL93)O%(2�RrHa:16�<=)?%32U+->?>�@E936�%3H*'*687)O%s@E936�`3)?[(+1<N@E)}@E621<L+-[(9�W� ��� $&%(R"H1<E[5HJ<E+-@=6S@=936[3<E6rBD6�<=6�%(Rr687Q'*6�7ERr<E)?`568'b)?%��P6�R1W � W � )?%�@=936^R"HJ7N@QBD43%(Rk@E)OHJ%H-B�)?%\@=6"2J6"<][(<=HJ21<L+-Z/Z/)O%32�[3<EH1`3>?6"Z�W $&%UH-@E936"<SFIHJ<E'37�n('*687N)?21%d@E936KRrH\7�@YBD43%(Rk@E)OHJ%)?%�7N45RL9�+_F +;Ab@=9(+-@S+�7=H1>?4*@=)?H1%�7E+a@E)?7NBDAP)O%(2_@=936�+-`eHa:16[3<E6rBD6�<=6�%(Rr687Q),7][3<EH*'*4(Rr68'`e6rBDH1<E6+-%3H1@=936�<QFQ93),RL9d'*HP687Q%3H-@]7E+a@E)?7NBDA�@E936[3<E6rBD6"<E6"%5Rr6�7�W� ��� � � [e6"%#[3<EH1`3>?6"Z����P4([3[5H\7N6t@=936 7NHJ>O43@=)?H1%^2J<E+1[39ZK4(7N@ 7E+a@E)?7NBDAC+-%K+J'3'*)O@=)?H1%(+1>RrHJ%(7N@=<L+-)?%J@8n*R"+->?>?6�' � ���� � � � � � � � ��� ��� � ��'*6"T(%36�'�+J7 BDH1>?>OHaF]7�u

� �������������� �� ����������������������������� $lB�@=936%3H*'*687QH-B @=9(6^7NHJ>O4*@E)OHJ%�2J<E+1[39+-<E6K[(>?+JRr6�'�H1%~+�7�@E<E+1)O2J9\@Y6�'*2J6#H1Bt+�7=6"Z/)Of )?%*T(%()}@E6#[3>,+-%(6K)?%�@=9(6#HJ<E'*6�<YH1Bp@=936�)O<H*R"R"43<=<E6"%5Rr6^)?%U@=9(6�7=6"%\@=6�%(Rr6Jn(@E936�6�'*2J6�7YR�+-%�`e6/'*<E+;FQ%UFQ)O@=9(H14*@Rr<EHJ7E7N)?%32_68+1RL9H-@E936"<8Wgy9(+-@/),7�@=9(6�R"H1Z/[3>?6rV*)O@�A H-BYT5%('*)?%32 +h7=H1>?4*@E)OHJ% 21<L+-[(9�@=95+a@b7E+a@=),7NT(6�7#@=9(6+-`eHa:16CRrHJ%(7N@=<L+-)?%J@Q`e6�7=)?'36�7 @=9(64(7N45+->�RrHJ%(7N@=<L+-)?%J@L7� �SW v n �SW z +-%(' �SW y �kW

Page 113: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� �

����� � � � � � ��� �� �S�

�/ �� ����� �"0 � <@?3<@? �� Q B � ��J�� Q,D�� �pH14�BD6�6�'/+7�@EH1<EAFQ<=)O@N@E6"%_)?% � <=)?AJ+S)O%\@EHC+R"H1Z/[34*@E6"<p7=A*7�@E6"Z +1%('�H14*@tR"H1Z/6�7�)O@E7@=<L+-%57N>,+a@E)OHJ%�)?%bqY)O%('3)�n*X +-Z/)O> nPop%32J>O),7N9�+1%('/H-@E936"<I>?+1%32145+-21687"Wm$l@I),7p)?%36rV*[e6"%(7=)?:161n)?Z�Z/68'*)?+-@=6�+-%('U7=)OZ#43>O@E+-%(6"H1457"W]XG936K>?+1%3214(+1216`(+1<=<E)?6"<L7QZ/6">O@i+;FG+;A1WGXG936K<E)?RL93f%3687=7SH-BtH1@=936�<Y>?)}@E6"<L+a@E43<=687YHJ[56�%(7S43[�@EHb6":J6"<EA1HJ%361WiXG936KF H1<E>?'�)?7S)O%\@E6">?>O68Rk@=45+->?>OA+-%5'~R"43>}@E43<L+->?>OA�4(%3)}@E6�'s)?%\@=H�H1%36JW_XG93)?7^)?7i@E936�'*<E6�+-Z H-BI[e6"HJ[3>?6_FIHJ<=�P)?%32�)?%s+B�+17ERr)?%(+-@=)?%32_+-<E6�+#H-B�<=687N68+-<LRL9bR"+1>O>?6�' X�+1RL9()O%36Xm<E+1%(7=>?+-@=)?H1%s� X�X]�rW� >O@=9(H1432J9#@E936Y+1`5Ha:J6 2JHJ+1>3)?7�B�+-<�BD<EH1Z <=68+->?)��8+a@E)OHJ%�na@=9(6QT(<L7�@t7=)O2J%(7�H1Be>?)OZ/)O@=68'7=4(R"R"6�7E7K+-<E6b+1[3[(+-<E6"%\@8W�$&% B�+1Rr@�n�@E936�T(<L7N@^B�+->O@=6�<=)?%32~7N@=6�[(7#)O%�X�X�FI6�<=6_@L+-�J6"%)?%s@=936 v ª �[� 7C+-%5' v ª � � 7�W W 4*@#+-@^@=95+a@^@E)OZ/61n BDHJ<=Z_+->I>O)?214()?7N@=),R"7^+1%(' +-<=@=)OT5R")?+1>)?%J@E6">?>O)?216�%(Rr6i9(+J'_`(+-<E6">?A/`56�6"%�`5HJ<=%�n*+1%('bR"H1Z/[34*@E6"<G7=R")O6�%(Rr6iF +J7t)?%b)O@E7 )?%*B�+-%5RrA1W� 7Y+#<E6�7=43>O@�nP@E9366r��H1<=@E7 �NB�+-)?>O68' �#@=H_+1RL93)?6":J67N4(R�Rr687=7�W <@?3<>= � B � � � ��� R � � � G��END ����"B,G�R �&GPQ,D�� gy9(+-@YZ_+-�1687G@=9(6'X�X @E+J7N��7NH�'3)}T5R"43>O@��s$l@YFG+17]`56�>O)?6":J6�'U+a@]HJ%36@E)OZ/6@E9(+a@S+1>O>@=95+a@�F +J7m<E6�c\43)?<E6�'CBDHJ<PX�X�F +J7 +Y`3)?>O)?%32145+->*'*),Rk@=)?H1%5+-<EAC+1%('^<E43>?6�7mBDH1< <E6"H1<L'*6�<=)?%32F H1<L'37 )O%�+/7N6�%J@E6"%(R"61W�{3HJ<Q6rV3+-Z/[3>?61nP@EH�@=<L+-%(7=>?+-@=6S@=936CBDHJ>O>?HaFQ)?%32�7=6"%\@E6"%(R"6YBD<EH1Zq])?%('*)�@=H�op%(21>?)?7=9�u

�;{>{P� { � } ����}7�;{ �>�,�;{>{ � � ��� � � � � ��� � � � � }7�7| � !{P� � z>��� � �;}-� �7�;} � �,}�z�� � � � � � � � �

@=9(6�qY)O%('3)�FIHJ<E'37S+-<E6K<E6"[3>,+1R"6�'U`PAUop%(21>?)?7=9�6�c\43)?:a+->?6"%\@E7i+-%5'�<E6"H1<L'*6�<=68'd@=H�BDHJ>}f>?HaF�@=9(6]7N68cJ4(6"%(R"6Q%3H1%*fl:16�<=`3f %3HJ43%K)?%(7N@=68+1'�H-Be%3H143%3f %3HJ43%*fl:16�<=`�W��]%*BDHJ<N@E43%(+-@=6">?A1nv �3v

Page 114: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v �\z ���������� � � � � ���$&%��� ��% ��� ��P$]��%

@=9()?7i%(+1)O:J6KZ/6r@E93H*'�B�+1)O>,7S@=HbF H1<E��216�%36"<L+->?>OAJW � %P43Z#`56�<SH1BI'*)O�_R"43>O@C[(<=HJ`3>O6�Z_7RrHJZ/6I)?%K@E936QFG+;A1n;>O)?�16GF H1<L'K7=6"%(7=6G7N6�>O68Rk@=)?H1%0n-RL93H1),Rr6 H-B�7N6�%J@E6"%(R"6Q7�@E<=4(Rr@=43<E61na[(<=H1f%3HJ43% <=6"BD6"<E6"%(R"61n�%3HJ43%*fl%3H143% Z/H*'*)OT5R"+-@=)?H1%�n�R"H1%:(�43%5Rk@=)?H1%57^>?)O�J67) +1%(' + +-%(' ) H1< +?n),'*6"%\@=)OT5R�+a@=)?H1%dH-B @=6�%(7=6^+-%('�Z/HP'(+->?)}@�AJn*6r@ER1W�g~6FQ)?>?>07N6�67NHJZ�6H1B0@E936�7=6`56�>OHaFWot+JRL9�F H1<L'd9(+17]Z/+1%PA�'*)O�e6�<=6�%\@]Z�68+-%3)?%32\7QH1<Y7=6"%57N687"WG�P6">?6�Rr@=)?H1%UH-B�@E936K+-[3f[3<EH1[3<E),+a@=6C7=6"%(7=6C)?7G%368Rr687=7E+-<EA/BDH1< @=<L+-%57N>,+a@E)OHJ%�W�{3H1<Q6"V3+-Z/[3>?61n3RrHJ%(7=)?'*6�<Q+-%3H1@=936�<7=6"%\@=6�%(Rr6C)?%�qY)O%5'*)�)?%dFQ9()?RL9O) (�H-@E+J+,+*9(+J7Q+/'*)}��6"<E6"%\@Y7=6"%(7=6i@=9(+1%O) [3>?H14(219 +?u�;{>{P� { � } � {7{����>� �>���!�>� !{P� � ��} � {���}-� �7�;} �7{,�>�

H1<�;{>{P� { � } � �!���!{7{ �>�,�;{7{ !{P� �!{,� � } �>� }-� �7��} �!�,� � }

XG9P4(7T) (�H-@L+1+E+"R"+1%`56p<E6"[(>?+JRr6�'i`PAV) [3>?H14(219 +?n[) [3<E6"[(+1<=6 +rH1<3) 9(+1<=%(6�7E7]+"'36"[e6"%('*)?%32]HJ%@=9(6S7=6"%(7=6Q)OZ/[3>?)?6�'_)?%/@=936i7N6�%\@=6"%5Rr61W�XG936YR"H1<E<=68Rk@t7=6"%(7=6]Z#4(7�@tT(<E7N@t`e6Y),'*6"%\@E)}T(68'BDH1<Q68+1RL9dH-Bm@=936F H1<L'37G`e6rBDH1<E67N6�>O68Rk@E)O%32�@E936^+-[3[(<=HJ[3<=),+a@E6S<E6"[(>?+JRr6"Z/6�%J@8WXG936p7=6"%\@=6�%(Rr6p7N@=<E4(Rr@=43<E6pZK457�@0+1>?7=HQ`56t)O%\@=6�<=[(<=6"@=6�'CR"H1<E<=68Rk@=>?AQBDHJ<�@=<L+-%(7=>,+a@=)?H1%0W{3HJ<Q6rV3+-Z/[3>?61n*)?%� � {�� !{P� } � � � � �7��} ���7z>z������7� �,�;}���}�z,} � �7� � }

XG936K@=6">?6�7ERrHJ[56�RrHJ43>?'�9(+;:16^`e6"6�%U@=9(6#)?%(7N@=<E43Z/6"%\@SH1Bt7N6�6")?%32(neH1< U]+-Z/687N9�R"H143>,'9(+;:J6K`e6"6"%hR"+1<=<EAP)O%32�@=936�@=6�>O687=R"H1[e61n�HJ<S)O@i),7S@=936/93)?>?> FQ)O@=9~@=9(6K@E6">?6�7ERrH1[e61W^XG9(6@=9(<=6�6S@E<E+1%(7=>?+-@=)?H1%�+-<E6i'*)O��6"<E6"%\@])O%UqY)O%('3)�u�;};� � }��7�>���7|!�>� � {��-�;{>{,�;{>{� ;{P� } � � ��� � {A�!{>{����7� � {,����}A���!{>{ �;};� � }� !{P� } � �������7�7���7|��>� � { �!} � {7{,�7� � {A�!{>{����7� � {,����}A���!{>{ �;};� � }� !{P� } � �������7�7���7|��>� � {��!{>{>z>�>� � {A�!{>{����7� � {,����}A���!{>{

q]6�%(Rr6Jn�)}@CF H143>,'�`e6#)?Z/[5HJ<N@L+-%\@i@=Hb),'*6�%J@E)}BDA�@=936�<=6�>?+-@=)?H1%(7=93)?[�H-Bt@=936#@=6�>O687=R"H1[e6RrHJ<=<E6�Rr@=>?Ab��R�+->?>O68'�@=936S7N6�%J@E6"%(R"6]7�@E<=45Rk@=4(<=6;�kWp�P4(RL9/),'*6"%\@=)OT5R�+a@=)?H1%57pZ/)O2J9\@p<=68cJ4()O<E6BDH1>?>?HaFQ)O%32_+�[(+1<E+121<L+-[39b+1%('�Z/+1)O%\@L+-)?%3)O%(2/+/R"H1%\@=6"V\@8W{3<E6�c\436�%\@=>?A1n-)O@t),7�)OZ/[eH1<=@E+1%J@�@EHCT(%('#@=9(6]<=6"BD6"<E6"%\@�H-Be@=936Y[3<=HJ%3H14(%�W �IHJ%(7N),'*6�<@=9(6CBDH1>?>OHaFQ)?%32_7N6�%\@=6"%5Rr6�7 BDHJ<Q6rV3+-Z/[3>?61u� �;� � � {� {��7�� � � �7�;}����>{�� ��� � ��{,�>��}-��|;{,�,� � �>� � � � }7};� ��� ���

XG936#T(<L7�@") )O@ +�R�+-%�<E6rBD6�<Y@EHd+d'*HJ2(n�RrHaF HJ<S<EHJ+J'�WC$lBIH1%(6KF 6"<E6^@=<L+-%57N>,+a@E)O%32�)O%\@EHq])?%('*) n*@E936216�%('*6"<QH1Bm@E936:16�<=`�FIHJ43>,'d'36"[e6"%('dH1%�@=9(6216"%5'*6"<QH1B0@=9(6<=6"BD6"<E6"%\@�u� {��!{ � � }���}A���!{A��{��;{ |>�!��� � ��{ � } z>{ � {>{

$lB�) :a+-95+,+*FG+17G<E6rBD6"<E<E)O%32#@=H�@E936^RrHaF H1<G@=9(6<=H\+1'�n\BD6"Z/)?%3)?%36^F H143>,'b`e64(7=6�'�W$l@SZ_+;AU7=H143%('�<=),'*),Rr43>?H14(7]@=Hd6":J6"%�R"H1%(7=)?'36"<]@E9(+a@S@=936�<EHJ+1'UR�+-%�`5+-<E�eneH1<i)O@Z_+;Ad7=6"6�Z HJ`P:\)?H1457Q@=95+a@S)O@S),7Q@E936#'3H12�FQ93),RL9U`(+1<=�*7�W]q]HaF 6":16�<�n(<=68+1RL93)?%32�7=4(RL9RrHJ%(Rr>?4(7=)OHJ%(7 <=68c\43)O<E6�7GZ/HJ<=6i@=95+-%V(�4(7�@]F H1<L'�<=6�[3>?+JRr6�Z�6�%\@Q+1`3)?>O)O@�A1W

Page 115: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ���[�n��!# ��P� � v ��yXG936/[3<EH1`3>?6"Z_7'*687=R"<=)?`e6�'h+-`eHa:16�[5HJ)O%\@C@=H�+�RrHJZ/Z�HJ%�@E936"Z/6Ju � 7=6"%\@E6"%(R"6ZK457�@]`e6 �N43%5'*6"<L7�@EHPHP' ����+a@]>?6�+17N@Q[(+-<=@=),+->?>?A*�I`e6rBDHJ<=6C)O@YR"+-%d`e6C@=<L+-%(7=>?+-@=68'�W�Y+-@=43<L+->m>?+1%32145+-2164(%('*6"<L7N@E+-%5'*)O%(2�)?7i+�95+-<L'd@E+17=�d`568R"+-457N6#)}@i<=68cJ4()O<E6�7]BDH1<=fZK4(>?+-@=)?%32b%3H1@YH1%(>OAU+_2J<E+1Z�Z_+1<QBDH1<S@=936#>?+1%32145+-216`(4*@C+1>?7=H�4(7=)?%32�`(+JRL�\2J<=HJ43%('�P%3HaFQ>?6�'*2J6_)O%(R">O45'*)O%(2~RrHJZ/Z�HJ%�7N6�%(7=6��P%3HaFQ>O68'*216JW � >?>t@E93),7KZ#4(7�@�`56�4(7=6�' )?%RrHJZ/[3>O6"V�+-%5'd+J7GA16"@G4(%3�P%3HaFQ%�FG+;A*7I@=H_[3<EH*Rr6�7E7G+�21)?:16"%�@=6"VP@�W

<@?3<�� � R � � � ��R R D � � ���XG936s'*)O�_R"43>O@�AwH1B^@=9(6�@L+17=��Z_+-�J6�7�)}@URr>?6�+1<�@E9(+a@�>O)O@=6�<E+-@=43<E6�+1%(' [eHP6r@=<EAy+-<E6`e6"A1HJ%(' X�Xh)O%C@E936�BDHJ<=687N6�6�+-`(>O6�BD4*@E43<E61Wm.06"2\+->a@E6rVP@E70FQ93)?RL9+1<=6pR�+-<E6rBD43>?>OAi'*<L+aB @=68'@=H~+;:1H1),'s+-Z#`3)O2J43)O@�A~+-%5's43%PF +1%J@E6�'h)?Z�[(>O),R"+-@=)?H1%(7KZ�)?219\@#+1>?7=HU`e6b`e6"A1HJ%('h@=9(6+-Z#`3)O@�H-B�X�XCW��JH1�1687/+-%('�H-@E936"<�Z_+-@=6"<E),+->QFQ93),RL9�<E6">?A HJ%wR"H1%P:16�AP)O%32s'*HJ43`3>?6Z/6�+1%3)O%(2/+1<=6+1>?7=H#%(H-@]21HPH*'dR"+-%5'*)?'(+a@=687 BDH1<�X�X�+a@Q[3<E6�7=6"%\@8W� <E6^@E936"<E6/+-%PAd@E+17=�U'*H1Z_+1)O%(7SFQ936�<=6 X�X ),7S+1[3[3>?)?R�+-`3>?6 �ygy93)O>?6/'*6rT(%()}@E)O:J67N@E+a@E6"Z/6"%\@YR�+-%3%3H1@Q`56Z_+1'361n*)O@S7N6�6"Z_7 @=95+a@Q@=9(6C@E+17=�b'*HJZ_+-)?%(7Q+-<E6C<E+-@=936�< %5+-<=f<EHaFW � @�T(<E7N@ 7=)?219\@ )O@�+-[3[e6�+1<E70@=9(+-@�R")O<LRr4(>?+1<E7�n;H-��Rr),+->PRrHJZ�Z#43%3),R"+-@=)?H1%�naZ/)?%\43@=6�7H-B*Z/6"6"@=)?%32J7�n8@=68RL93%3),R"+->1>O)O@=6�<E+-@=43<E6p)?%(Rr>?4('*)?%32Y7ERr)?6"%\@=)OT5R�[5+-[e6"<L7"n8Z_+-%P4(+->,7�6"@ER-W +-<E6+-[([3>O),R"+-@=)?H1%(7p@=9(+-@GR�+-%�`e6i9(+-%('3>O68'_`PA X�XCWPXG9(6�7=6]@=6"VP@E7I9(+;:16]>?)?Z�)O@=68'�:JHPR�+-`343f>?H1<EAb+-%('bT3V*6�'�7N@�AP>O687"W�XG936�)O<]+14('*)?6"%(R"6)?7G%3H1@]:16�<=A_>,+-<E216JW�X�+-%PA�H-B�7=4(RL9b@E6rVP@E79(+;:J6/+U7=93HJ<N@^>?)}BD6JW �I)?<LRr43>,+-<L7+-%('hZ/)?%\43@=6�7KH-BQZ/6"6"@=)?%32J7^+1<=6/4(7=6�'s)?%\@=6�%(7N)?:16�>OABDH1<G+K7=93HJ<N@ [56�<=)?H*'_H-B�@E)OZ/6JnP+1%('/@E936"%bT(>O68'b+1%('/BDH1<E21H1@N@E6"%�W�XG936�A/+1<=6S+->,7NH�RrH1%3f7=)?'*6�<=68'b4(%3)O%\@E6"<E6�7N@=)?%32/`\A�9P43Z_+-%�@=<L+-%(7=>?+-@=HJ<E7�WPW 68R"+-457N6CH-B @=9(6^+-`eHa:16i<=68+17=H1%(7�n@=9(6�7=6�@=6"VP@E7�+-<E6�)?'36�+-> R"+1%('*),'3+a@E6�7KBDH1<VX�XCW qYHaFI6�:16"<8nm@=936�<=6d+-<E6�%3H�[3<L+1Rr@=),R"+1>+-43@=H1Z_+-@=),R7NA*7N@=6"Z_7GBDHJ<]@E<E+1%(7N>,+a@E)OHJ%�H1@=936�<Q@=95+-%UH1%(6^7NA*7N@=6"Z�)?%�@=936K'3H1Z_+-)?%�H-BZ/6r@E6"H1<EH1>?H12J)?R�+->5BDH1<E6�R�+17N@E7�W�PH B�+-<dFI6~9(+;:16�'3)?7ERr4(7E7=6�' X�X +17b+�BD43>?>OA +14*@=HJZ/+-@=),R�7=A*7�@E6"Z <=68c\43)O<E)?%32%3H�9\4(Z/+1%y)O%\@E6"<E:16"%\@E)OHJ%�W XG936�<=6�+1<=6�H-@=9(6"<b[eHJ7E7=)O`3)?>?)}@E)O687�+J7�F 6">?>�W � %36�R"+1%9(+;:J6]9P43Z_+-%�+-),'*68'_Z_+1RL93)?%36Q@E<E+1%(7N>,+a@E)OHJ%�W�XG936Y9P43Z_+-%~� @=<L+-%57N>,+a@EH1<k��RrH14(>?'_[(<=6"f6�'3)}@d@=936~@=6"VP@d)?%y@=9(6h7=H143<LRr6~>?+1%32145+-216U[5+-<L+-[393<L+17=)?%32s@=936s'*)O��Rr43>O@�7=6"%\@E6"%(R"6RrHJ%(7N@=<E4(Rk@E)OHJ%(7I7=H^@E9(+a@ @=9(6iR"H1Z/[34*@E6"<GR"+-%�43%('*6�<E7N@E+1%('_)O@�n*HJ< +1)?'/@E936CRrH1Z/[343@=6"<'*43<E)?%32�@=936C@E<E+1%(7N>,+a@E)OHJ%�[(<=H*Rr687=7 FQ936�%�)}@]9(+J7]+/'*)O�_R"43>O@�Ab)O@YR"+-%(%3H-@Q9(+1%('*>?61n3HJ<[eHJ7N@Nfl6�'*)O@�@=936Q2J6"%36�<E+-@=68'@=6"VP@p)O%�@=9(6G@E+-<E216"@�>?+1%3214(+1216JW0XG936�X�Xw7NA*7N@=6�Z 7N9(H143>,'`e6:\)?6"F 6�'d+17Q+#@EH\HJ>�[3<EHa:P)?'*68'_@EH/@=9369P43Z_+-%�@=<L+-%57N>,+a@EH1<8W

XUH\7�@�X�X 7NA*7N@=6"Z_7S[3<E6�7=6"%\@]@=H*'3+;Ad<E6�c\43)?<=6^[eHJ7N@Nfl6�'3)}@E)O%325W��YH-@=6K@=9(+-@S)OBp@=9(6X�X 7=A*7�@E6"Z_7Y`e6�R"H1Z/6^<E6�+J7NHJ%(+-`3>?Ab2JHPHP'�n(@E936K[eHJ7N@S68'*)}@EH1<i%36"68'37Y@=H��P%3HaF H1%(>OAH1%(6i>,+-%(214(+12161W <@?3< ; � B D � ����D@R Q �3B�FXG936�93),7�@EH1<EA�H1B X�X R�+-%�`e6K@E<E+JRr68'�7�@L+-<=@=)?%32�BD<EH1Z�@E936#68+-<E>OA �[� 7]FQ9(6"%�)O@CF +J7<E6�+->?)��"6�'�@=9(+-@^RrH1Z/[343@=6"<L7CRrHJ43>?'~`e6�457N68'�BDHJ<S@E<E+1%(7=>?+-@=)?H1%�W#$&%�@E936 �S��n�+d>,+-<E216%P43ZK`e6"<GH1B0<=687N68+-<LRL9_21<EH143[57I7=[3<L+-%32#43[b@EH#F H1<E�/H1%b@=936i@E+J7N�U��4(7N45+->?>OA*U]4(7=7=),+-%

Page 116: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v � © ���������� � � � � ���$&%��� ��% ��� ��P$]��%

@=H�ot%321>?),7N95�rn3FQ)O@=9�BD43%('3)O%32�BD<=HJZ '*6"BD6"%(R"6^+-%('d)?%J@E6">?>O)?216�%(Rr6687�@L+-`3>?),7N93Z/6�%J@L7"WI$&%@=9(6 �S�3�,Un3@E936"<E6^FG+17Q+_7=)OZ/)?>?+1<]6r��H1<=@Q@=H_@E<E+1%(7=>?+-@=6iBD<=HJZ ot%321>?)?7=9U+-%('�{(<=6�%(RL9@=H UQ457=7=)?+1%�W� 7 Z/6"%\@E)OHJ%36�'�6�+1<=>?)O6�<�n\Z/HJ7N@QH-B�@E93)?7GF H1<E�/`(+17=6�'�)O@E7=6">OBmH1%�`3)?>O)?%32145+->�'*),Rk@=)?H-f%(+1<=A~>OHPH1�P43[0W�XG936�'*6�:16�>OHJ[56�<E7^c\43),RL�P>OAs7N@E+-<=@=68's<=68+->?)���)O%(2�@=9(+-@KB�+-<KZ�HJ<=6bF +J7%36�6�'*68'�W*W 4*@^43%*BDHJ<N@E43%(+-@=6">?A1nm)O%h@E936")?<^6"%\@E9\457N),+17=Z +-%5'�HJ[*@=)?Z/)?7=Z '*4(<=)?%32�@=9(66�+1<=>?A_'3+;A*7"n\@E936"A�95+1'�[3<=H*R">?+1)OZ/6�'_@=9(+-@ X�X 7=AP7N@=6�Z_7IF 6"<E6C+-<EH143%('_@=936RrHJ<=%(6"<8n+-%5'@=95+a@ @=936 X�X�7=A*7�@E6"Z_7mFIHJ43>?'K`56GR"+1[(+-`(>O6 H-B([(<=H*'*4(R")O%(2Y93)?219*f&c\4(+->?)O@�AS@E<E+1%(7Nf>,+a@=)?H1%57 BDH1<Q216�%36"<L+->5@=6"VP@E7QFQ)O@=93HJ4*@Y+-%PA_9P43Z_+-%d)?%J@E6"<E:16�%J@E)OHJ%�W�XG9P4(7G)O%d@E936 �S��nFQ936�%�+/R"H1Z/Z/)}@=@=6"6^R�+->?>O68' � .0� � �yF +J7Q7N6"@]43[d@=H_6�:;+1>O45+a@=6i@E936 X�X <=687N68+-<LRL9�n)O@K6�+J7N)?>OA~R"+-Z/6/@EH�@=936bR"H1%(R">O457N)?H1%h@=95+a@^<E6�7=6�+-<LRL9�95+1'~B�+-)?>O68'h@=HU>?)O:J6_43[s@=HU)O@E7[3<EH1Z/),7N687"WQ$l@C7=+1)?'�)?%�)O@E7]<E6"[eH1<=@Y)?% v ª � � @E9(+a@i`(+17=)?RC<E6�7=6�+1<ERL9�FG+17Y%36"68'*6�'U+1%('X�X F +J7 %3H-@QBD68+17=)O`3>?6C)O%d@E936CBDH1<E6�7=6"68+-`3>?6YBD43@=43<E61W

XG936 � .0� � ��<=6�[5HJ<N@�<L+-%32i@=9(6Y'*6�+-@=9/�P%36">?>3H1B X�X�6r��H1<=@E7p)O%/@E936 �S�/+-@�@=9(+-@@=)?Z/61W � >?>�BD43%('*)?%32URr68+17=6�'�n�@E936/<=687N68+-<LRL9�21<EH143[57S'*),7=)O%\@=6�21<L+a@E6�'�n�+-%5'�@E936�T(6">,'F 6"%\@p)O%�'3)?7=<=6�[34*@E61W�XG936QB�+-@=6QH-B X�Xw)?%�op43<EH1[e6]+-%5'K@E936 �i�3��Uy'*),'_%3H1@tRL9(+-%32J67=H�'3<E+1Z/+-@=),R"+1>O>?A1W_$l@KFG+17C2J6"%36�<E+1>O>?AU<E6�RrHJ21%3)��"68'�n�93HaF 6":J6"<8n�@=9(+-@K)O@^F +J7+dT(6">,'FQ93H\7N6b@=)?Z�6�9(+1' %3H-@�A16"@�RrHJZ/61W � %3>OA +�BD6"F <E6�7=6�+-<LRL9s21<EH143[57KRrHJ%\@=)?%\4(6�'s@EH<E6"Z_+-)?%d+JRk@E)O:J61WXG936#T(6">,'�<E6":P)?:168'U)O%�@=936�>,+a@=6 � � 7S+-B @=6�<S@E936/7N4(R�Rr687=7NBD43>�RrHJZ�[(>O6"@=)?H1%�H1Bp@=9(6X � �X�f X�otXQo � 7=A*7�@E6"Z )O% � +1%(+1'3+h)?% v ª � �PW $l@�@=<L+-%57N>,+a@E6�7�@=9(6 � +-%(+J'*),+-%F 6�+a@E936"<�BDHJ<=68R"+J7�@L7 BD<=HJZ op%(21>?)?7=9K@EH^{3<E6"%(RL90W � <=HJ43%('#@=936]7E+-Z/6G@E)OZ/6QH-@E936"<I7NA*7Nf@=6�Z_7Q>O)?�16^XG)O@=457^��ot%321>?)?7=9�@=H�{3<E6"%5RL9bBDHJ<Q@=6"V\@E)O>?6C@=68RL93%3HJ>OHJ21A3�kn � �S.*X � �I93)O%(6�7=6@=HCop%(21>?)?7=9^BDHJ<�X�+a@=9(6"Z_+a@E)?R�7 +1%('K�t9PAP7=),R"7E(�H143<E%(+->,7L�kna6r@LR-W FI6�<=6 +->,7NHi'*6":J6">?H1[e6�'�W$&%/@=9(6 #[� 7"na@E936 �\+-[5+-%3687N6Q7=4(R"R"6�7E7�BD43>?>?A#RrHJZ/[3>O6"@=68'_+%(+a@E)OHJ%(+->([3<=H[(�6�Rr@Y� XU45�H1% X�X�`e6r@�F 6"6�%�op%32J>O),7=9�+-%(' �\+-[(+1%36�7=61W XG936Sot43<EH1[e6�+-% �IHJZ�Z#43%3)O@�AK9(+J7t+1>?7=H43%('36"<=@E+-�J6"%�+-%U+-Z#`3)O@=)?H14(7Q[(<=H[(�6�Rk@]R�+->?>O68'dot43<EH-@=<L+�RrHa:16�<=)?%32/+->?>�@=9(6^>?+1%32145+-21687H-B @=9(6��IH1Z/ZK43%()}@�AJW�g~HJ<=��9(+17^+1>?7=H�`56�6"%s43%('36"<=@E+-�J6"%h`PA�21<EH14([(7i)O%�{(<E+1%(Rr6Jn

�i6"<EZ_+-%PA1n(�*FQ)}@ �"6"<E>,+-%('�nP@E936 �S�d+1%('b$&%5'*)?+(W <@?3< � � ��R R D � � � � LLB �3G��EN��#RXG936�<=6i+-<E6Q@=93<E6"6SZ_+:(�H1<t@�AP[5687tH1B X�Xy7NA*7N@=6�Z/7t@=95+a@GH1%36YR�+-%�)?Z_+-2J)O%36S`(+17=6�'/HJ%@=9(6")?<G'36"[e6"%('*6�%(Rr6CHJ%b>,+-%32J4(+-2J6�7�W XG936ST(<L7�@ @�AP[56CH1B#X�X 7=A*7�@E6"Z_7G+-<E6i'*687N)?21%(6�'BDH1<m+G[(+-<=@=),Rr43>,+-<�[5+-)?<�H-BP>?+1%32145+-21687"W�$lBP@E<E+1%(7N>,+a@E)OHJ%iR�+-[(+1`3)?>O)O@�A]),7�%36�6�'*68'S`e6r@�F 6"6�%+-%(H-@=9(6"<Y[5+-)?<YH-Bp>,+-%(214(+1216�7�n(+b%36"F 7=A*7�@E6"Z�ZK4(7N@S`e6#R"H1%(7N@=<E4(Rk@E6�'�W�WI68R"+14(7N6KH-B)O@E7t'36"[e6"%('*6�%(Rr6YH1%�@=936Y>?+1%3214(+121687"n;@E936Y7=AP7N@=6�Z 9(+J7�@=9(6Y+1'*:a+1%J@L+-2J6I@E9(+a@t7=[e6�Rr),+->BD6�+-@=43<E6�7I+-%('b7N)?Z/)O>,+-<E)}@E)O687p`e6r@�F 6"6�%_@=936CRrHJ%(Rr6�<=%(6�'/>,+-%32J4(+-2J6�7pR�+-%_`e6YZ_+1'*6S4(7=6H-B�W�$l@]),7QR"+1>O>?6�'b@=9(6^'*)O<E6�Rr@Y+-[3[(<=H\+1RL9�W

XG936b7=6�R"H1%('h@�AP[e6bH1BQ7=A*7�@E6"Z )?7#`(+J7N68'~HJ% @=9(6�RrHJ%(Rr6�[*@KH1BG)?%\@=6�<=>?)O%(214(+(W �7=6"%\@=6�%(Rr6I)O%�+S7=H143<LRr6t>?+1%3214(+1216p),7mT(<L7�@�+-%(+1>OA �"68'^+-%5')?7 <E6"[3<E6�7=6"%\@E6�'C)?%#+-%#)O%\@E6"<=fZ/6�'*),+a@E6^>,+-%32J4(+-2J61WQXG936K)?%\@=6�<=Z/6�'3)?+-@=6^>,+-%32J4(+-2J6%36"68'�%3H-@i`56�+_9P43Z_+-% �=%(+a@=f43<L+->�K>,+-%(214(+1216C+-%('d),7G@�AP[3)?R�+->?>OA�+KBDHJ<=Z_+1>��NZ_+a@E936"Z_+a@E)?R�+->�K>,+-%(214(+12161W �]6"VP@Y+

Page 117: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ���[�n��!# ��P� � v � �216�%36"<L+a@EH1<C@L+-�1687C@=9(6�)O%\@E6"<EZ�68'*),+a@=6b<=6�[3<=687N6�%\@E+a@E)OHJ%h+1%('s216�%36"<L+a@E6�7^+U7=6"%\@E6"%(R"6)?%�@=9(6^@E+1<=2J6r@i>?+1%3214(+1216JWSXG936#Z/+�(�H1<i+1'*:a+-%\@L+-216KH-B�@=9()?7C+-[([3<=H\+1RL9U),7]@E9(+a@i@=9(6+-%5+->?A ��6"<]H1Bp[(+-<L7=6"<QBDHJ<]@=9(6#7=H143<LRr6>,+-%32J4(+-2J6)?7Y)O%5'*6"[e6"%('36"%\@iH1B�@=936#216"%(6"<L+a@=HJ<BDH1<C@E936/@E+1<=2J6r@C>?+1%32145+-216JW � 7^+d<=687N43>O@�n0)}BGH1%36/FG+-%\@E7S@EHU`343)?>?'s+d7NA*7N@=6"Z FQ)}@E9@=<L+-%57N>,+a@E)OHJ%dR�+-[(+1`3)O>?)O@�A�+-Z/HJ%3216Jn37=+;AJn v � >,+-%32J4(+-2J6�7�n*H1%3>?A v � [5+-<L7N6�<E7Q+1%('d216"%3f6"<L+a@EH1<L70%(6"6�'^@=HC`e6GR"H1%(7N@=<E4(Rr@=6�'�W �IH1%\@E<E+J7�@�)}@�FQ)O@=9 z*v � � � v � V v ©P��7=A*7�@E6"Z_7m@=9(+-@%36�6�'�@=H/`e6^RrH1%57�@E<=4(Rr@=68'b)?%d@=936CT(<L7N@Q+1[3[3<EHJ+JRL9�W

XG936�'*)}��R"43>}@�A�FQ)O@=9�@=936/7N68RrHJ%('U+-[3[(<=H\+1RL9�n593HaFI6�:16�<�n5)?7Y@=9(+-@i)O@S),7i'*)}��R"43>}@@=H '*6"T(%36~@=936h)O%\@E6"<E>O)?%32145+3W � >,7NH5nY)O@d),7d%3H-@d[5H\7=7=)?`3>O6~@=H�@E+1�16h+1'*:a+-%\@L+-216�H-B7=)OZ/)?>?+1<=)O@=)?6�7#`56"@�FI6�6"%�>?+1%3214(+121687"W � 7�+�<E6�7=43>O@�n�Z_+-%PA <E6�7=6�+1<ERL9s21<EH14([(7K457N6d+@=9()O<L'~+1[3[3<EHJ+JRL9�R"+->?>?6�'U@E936�@=<L+-%(7NBD6"<+1[3[3<EHJ+1RL90Wi$&%~@=9()?7C+-[([3<=H\+1RL9�ne@E936/[(+-<L7N6�<[3<EH*'*4(Rr687�@E936Y<E6"[3<E6�7=6"%\@L+a@=)?H1%�BDHJ< +^7=H14(<ER"6]>?+1%32145+-216Jn-FQ93),RL9�),7p@E936"%_@E<E+1%(7NBD6"<E6�'@=Hh@E936U<=6�[3<E6�7=6"%\@E+-@=)?H1%�BDHJ<�@=936�@L+-<E216r@/>,+-%32J4(+-2J61W XG936�216"%(6"<L+a@=HJ<�@E+-�J6�7�Ha:16�<BD<EH1Z|@E936"<E61W�XG93),7K+1[3[3<EHJ+1RL9~)?7K)O%\@E6"<EZ�68'*),+a@=6_`e6r@�F 6"6�%s@=936�T(<E7N@@�F H(W�{(H1< v �>,+-%32J4(+-2J6�7�nQ)O% @=93),7�+1[3[3<EHJ+JRL9yH1%3>?A v � [(+1<E7=6"<L7b+1%('y2J6"%36�<E+-@=H1<L7�+1<=6~%36"68'*6�'�n93HaF 6":J6"<8nJ@E936%P43ZK`e6"<QH1B0@E<E+1%(7�BD6�<]RrHJZ�[eH1%(6"%\@E7G%36�6�'*68'�+-<E6 z3v � W$&%d@=936$&%5'*)?+1%�RrHJ%J@E6rVP@QFQ936"<E6C@=9(6"<E6^+-<E6C+/>,+-<E216C%P43Z#`56�<]H-B�>?+1%32145+-21687C�DH-B fT5R")?+1>O>?A v � Z_+:(�HJ<]H1%(6�7L�QFQ93),RL9�+-<E6K+1>?7=H�:16�<=A�Rr>?HJ7=61n5@=9(6K)?%J@E6"<E>O)?%32J4(+�+-[([3<=H\+1RL9F H143>,'�7=6"6�Zj[3<E6rBD6�<E+1`3>?61nP`34*@Q@E936%(+a@E43<E6H-Bm)?%\@=6�<=>?)O%(214(+�),7GH1[e6"%�W

<@?3<�� M J�B,B ���Q � Q�GPQ�J�R�I43<E<=6�%\@=>?A @=936hT(6�>?' )?7�2JH1)?%32�@E93<EH1432J9 +w[39(+J7N6hH-BK:P)?21HJ<=HJ4(7�+JRk@E)O:P)O@�A1W XG9(6�\+-[(+1%36�7=6 �Y+a@E)OHJ%(+->m�p<EH�(�6�Rr@^� XU45�Y7N45R"Rr687=7NBD43>?>OAdRrHJZ�[(>O6"@=6�'d<E6�7=43>O@=)?%32_)O%�+1%�)O%*f'*4(7N@=<E),+-> [3<=H1@=H1@�A\[e61WighH1<E�d95+17i+->?<=68+1'*A�7�@L+-<=@=68'UH1%h+�Z_+:(�HJ<S'*6�:16">?H1[(Z�6�%\@S6rB fBDH1<=@�W�ot43<=H1@=<L+K[(<=H[(�6�Rk@G)?%�ot43<EH1[e6S9(+J7 9\4(%('*<E6�'37GH1Bm<E6�7=6�+-<LRL936�<E7tFIHJ<=�P)?%32#HJ%�)O@�W$l@I457N687�@=936Y@=<L+-%(7NBD6"<I+-[3[3<EHJ+JRL9/)O%_FQ93),RL9�+C@E<=6�6]<=6�[3<E6�7=6"%\@E+-@=)?H1%/H-B�+^7=H143<LRr6Q>,+-%3f2145+-21687I7=6"%\@E6"%(R"6S),7GH1`*@L+-)?%36�'b`PAb+#7=6"<E)?6�7 H-B�7�@E6"[(7 )?%\:JH1>?:P)O%32KBDH1<EZ_+->�21<L+-Z/Z_+-<L7+-%5'�F 6">?>�BDH1<EZ�68'*%3687=7YT3@=6�<E7�W#XG9()?7i<E6"[3<E6�7=6"%\@E+-@=)?H1%�),7S@=<L+-%(7NBDH1<EZ/6�'�@=H�+-%3H1@=936�<@=<E6"6i7�@E<=45Rk@=4(<=6S4(7N)?%32K@=936S@=<L+-%(7NBD6"< RrHJZ�[eH1%(6"%\@�n*+-%5'/BDH1<EZ_7p@E936S`5+17=)?7pBDH1< 216"%(6"<=f+a@E)OHJ%�W � %P43ZK`e6"<]H1BmH1@=936�<Q<=687N68+-<LRL9b21<EH14([(7G+-<E6C+1>?7=H/+1Rk@E)O:J6C)O%Uop4(<=HJ[56JW

$&%('*),+~@=HPHs9(+17_+JRk@E)O:J6d2J<=HJ43[(7�)?% X�XCWtXG936�6�+1<=>?)O687�@_[34(`3>O),7=936�'wF H1<E� F +J743%('36"<=@E+-�J6"%�`PA �I9(+1�P<E+1`5HJ<N@�A_)?% v ª � � W XUH1<E6C<=68Rr6"%\@E>OAJn(F H1<E��9(+17]`56�6"%U43%('36"<=f@E+1�16�%�)?%~X +-Z/)O>��Y%3)?:16"<L7=)}@�AUXG9(+1%:(N+;:P43<�n �S+a@=)?H1%5+-> �I6"%\@=<E6#BDH1<^�PH-B @�FG+-<E6#Xm6�RL93f%3HJ>OHJ21AU� � �G�*X]��W H1ZK`5+;A1n �I6"%\@=<E6SBDH1<�ZS6":16�>OHJ[3Z/6"%\@GH-B � '*:a+-%(R"6�' �IH1Z/[34*@E)O%(2� �tf Z � �G�I�p43%(61n*+-%('b$N$�X "+1%3[343<8W�UQ6�7=6�+1<ERL9_2J<=HJ43[b+a@QXG9(+1%:(N+;:P43<I+-@N@=6�Z/[*@=68'UQ4(7E7=)?+1%_@=H/Xm+1Z/)O>e@=<L+-%57N>,+a@E)OHJ%�`(+17=6�'�H1%�@E936C'*)O<E6�Rr@G+1[3[3<EHJ+JRL9_)O% v ª # � +-%5'_@=9(6T(<L7�@]7=A*7�@E6"Z @E<E+1%(7N>,+a@E6�'d7N)?Z/[3>?6C7=6"%\@E6"%(R"6�7�W � 2J<=HJ43[�+-@ � �G�*X�'*),'d7=H1Z/6iFIHJ<=�H1%�ot%321>?),7N9�@=H#q])?%('*)5@=<L+-%(7=>?+-@=)?H1%/`34*@G'*),'_%3H-@ '*6":J6">?H1[_+F H1<E�\)?%32^7=A*7�@E6"Z�W XG9(621<EH14([h+-@ �tf Z � � '*),' 7NHJZ/6_[3<=6�>O)?Z/)O%5+-<EA�FIHJ<=��H1% X�XCn�`343@K9(+17^>?+-@=6">?A�`e6"6�%RrHJ%(Rr6�%\@=<L+a@=)?%32UHJ%�[3<EHPR"6�7E7N)?%32UH1BS�*+-%(7=�P<=)O@�W~XG936b$=$�X "+-%3[34(<K6r��H1<=@K`PAy� � �Jf7=9(+-<�W 9(+-<L+a@E)�21<EH143[5�Y),7i@=936/Z/HJ7N@^RrH1Z/[3<E6"9(6"%(7=)O:J6#+1%('�),7iBDH*Rr4(7=)?%32�HJ%~$&%5'*)?+1%>,+-%32J4(+-2J6�7�W�$l@ 9(+J70+1[3[3>?)O68'C@=936I[3<E)O%(R")O[(>O6870H1BP$&%5'*)?+1%@=<L+1'3)}@E)OHJ%(+->J21<L+-Z/Z_+-<t� �*+-%*f

Page 118: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v � � ���������� � � � � ���$&%��� ��% ��� ��P$]��%

7=�\<E)O@S:PAJ+1�;+1<E+1%(+J�I@EHbZ/H*'*6"<E%�$&%('3)?+1%�>?+1%32145+-21687"W��]%3)?:16�<E7=)}@�AdH-BtqYA*'*6"<L+-`(+J'�)?7+-%d)?Z�[eH1<=@E+1%\@YRr6"%\@E<=67N@E+-<=@=)?%32�FIHJ<=�_HJ%URrH1Z/[343@E+a@E)OHJ%(+->�>?)?%32143),7N@=),R"7Q+-%5' X�XCWXG936OX�X 7NA*7N@=6�Z/7bFQ)O>?>i9(+;:16U@EH�T3@d)O% +-% HJ<=2\+-%3)���+-@=)?H1%�W $&%(7N@=68+1'yH1B^<=6"f[3>,+1R")O%32�[56�H1[3>?61n�@E936"A FQ)?>O>GRrHJZ/[3>O6�Z/6"%\@K@E936"Z�W~XG9(6"<E6�R"+1% `56dH-@E936"<KB�+->?>OHJ4*@E7BD<EH1Z @E936 X�X 6"�eHJ<N@8W � @_+1%�)?%\@=6�>O>?6�Rr@=4(+1>]>O6�:16�>�nI)}@bR�+-%w21)?:16�+~`()O2s`eH\H\7�@/@EH@=9(6�@=<L+1'3)}@E)OHJ%(+->I�3+-%(7=�P<=)O@^:PAJ+-�a+1<E+1%h7N@=4('3)O687"n�>?)O%32J43),7�@E)?R�7K+-%5' +-<=@=)OT5Rr),+->p)?%\@=6�>O>?)}f216�%(Rr6�'*),7=R")O[3>?)?%36�7�WSXG93687N6#FQ)O>?>�21<EHaF @EHb%36�F 936")?219\@L7Y`eH1<E<=HaFQ)?%32/BD<EH1Z H1%(6#+-%3fH-@E936"<8W � @I@E936i[3<E+JRk@E)?R�+->e>O6�:16"> nPH1%36CR"+1%�)?Z/+121)?%36C+^%P43ZK`e6"<GH1BmRrHJZ�[(4*@=6�< `5+17=6�'[3<EH*'*4(Rk@L7"W�{3H1<6"V3+-Z/[3>?61n0>,+-%(214(+1216_+17E7N),7N@E+-%\@_��+U7=A*7�@E6"Z|@E9(+a@KR"H1<E<=68Rk@L7C21<L+-Z�fZ_+a@E)?R�+->0Z/),7�@L+-�J6�7L�kn(R"H1Z/[34*@E6"<S+J7=7=),7�@E6�'d>?+1%32145+-216C)?%(7N@=<E4(Rk@E)OHJ%��DFQ93),RL9U)O%5Rr>?4('*6�7:a+-<E)OHJ4(7]>?6�7E7=H1%(7Q)?%(R">O4('3)O%32dRrHJZ�[(<=6�936"%(7=)?H1%�@=687�@L7]BDHJ<Y>,+-%32J4(+-2J6C@=68+1RL93)?%32\�rn5%5+a@Nf43<L+->m>?+1%3214(+1216^)?%\@=6�<NB�+JRr6�7]@=HdRrH1Z/[343@=6"<L7K��7NHb@=9(+-@iHJ%36KR�+-%�R"H1Z/ZK43%()?R�+a@=6#FQ)}@E9RrHJZ/[34*@=6�<E7#4(7=)O%(2�>,+-%32J4(+-2J68�C6"@ER-WsXG936dZ_+-<E<=),+-2J6_H-BY7=[56�6�RL9 [(<=H*Rr687=7=)?%32UFIHJ<=�FQ)O@=9U%(+-@=43<L+->�>,+-%32J4(+-2J6C[3<=H*R"6�7E7N)?%32/9(+17Q@=936[eH-@E6"%\@=),+->mH-B�[3<=H*'*45Rr)?%32_RrH1Z/[343@=6"<7=AP7N@=6�Z_7G@=9(+-@YR"+1%d>?),7�@E6"%�+-%5'b@L+->?��Wp$lB�@=936^HJ[*@=),R"+1>�RL9(+-<L+1Rr@=6�<Q<=68RrH12J%3)O@=)?H1%�@E6�RL9*f%3HJ>OHJ21AK),7 +->,7NHKR"H1Z#`3)O%(6�'�n\)}@GR"+1%�>O68+1'�@EH#7=AP7N@=6�Z_7�@=95+a@ R�+-%�<E6�+J'/H14*@ `5HPHJ�P7S� @EH@=9(6`3>O)?%('�n3BDH1<Q6rV3+1Z�[(>O6;�kWghH1<E�/BDH1<G$&%('*),+-%d>?+1%32145+-21687 FQ)O>?>�9(+;:16S@=H�`e6^'*H1%36CZ_+-)?%3>?A�`PA_$&%('*),+-%(7�W�gh6+-<E6^+->,7=H#@E936^`e6�7N@Y6�c\43)?[3[e6�'d@EH�'*H_)}@8W XG9(6^[3<EH1`3>?6"Z_7]+1<=6RL9(+1>O>?6"%32J)O%(2/+1%('d@=9(6[eH-@=6�%\@=),+->�)OZ/Z/6"%57N6JW gy95+a@Q)?7 %36�6�'*68'�),7G+^%(+-@=)?H1%(+1>5FQ)?>O>�+1%('�+#%(+a@E)OHJ%(+->e6r��H1<=@�W

�/ .- � ���98 ���� � �#� � �^� �#� � �V0 �|�Q� 08#8 �K��

$l@b),7b[eHJ7E7=)O`3>?6U@EH�Ha:16�<ER"H1Z/6d@=936~>?+1%3214(+1216U`(+1<=<E)?6"<�)?%y$&%('*),+ @EHP'(+;A 4(7=)O%(2+-%P4(7E+-<L+-�a+(W � %P4(7E+-<L+-�a+_@E<=)?6�7i@EH�@L+-�J6�+J'*:a+-%\@E+1216KH1Bt@E936/<=6�>?+-@=)?:16/7�@E<=6�%32-@E9(7iH-B@=9(6tRrHJZ�[(4*@=6�<m+-%5'Y@E936t9P43Z_+1%i<E6�+J'*6"<8n8FQ936"<E6�@=936IRrH1Z/[343@=6"<0@E+1�16�7�@=936p>,+-%(214(+1216>?HJ+1'U+1%('�>?6�+;:1687G@=9(6KF H1<E>?'��P%3HaFQ>?6�'*2J6>OH\+1'�HJ%�@=936#<=68+1'*6�<�WG$l@S),7S[(+-<=@=),Rr43>,+-<E>?A6r��6�Rr@=)?:16]FQ9(6"%�@=936Y>?+1%3214(+121687�+-<E6]Rr>?HJ7=61n1+J7�)?7p@=936SR"+17=6GFQ)}@E9_$&%('*),+-%_>,+-%32J4(+-2J6�7�W"C6"6�[3)?%32_)O%�>?)O%(6^FQ)}@E9�@=936#+-%P4(7E+-<L+-�a+K[(93)O>?HJ7=H1[(9\AJn*)}@S`3<=),'*2J6�7G@E9362J+1[d`e6r@�F 6"6�%>,+-%32J4(+-2J6�7�`PA^RL93H\7N)?%32Y@=936 Z/HJ7N@�+1[3[3<EH1[3<E)?+-@=6pHJ<m%(6�+-<E6�7N@ R"H1%(7N@=<E4(Rr@=)?H1%K+;:a+-)?>,+-`3>?6)?%�@E936C@E+1<=2J6r@Q>,+-%32J4(+-2J6]@=HJ216"@=936�<QFQ)}@E9�7=43)O@E+1`3>O6^+J'3'*)O@=)?H1%(+1>�%3H-@L+a@E)OHJ%�W

$l@t),7t+1<=2J436�'#)O%�@=93),7t7=6�Rr@=)?H1%�@=9(+-@t@E936"<E6]+-<E6QH1%3>?A#@=93<E6"6QZ_+:(�HJ<t'*)O�e6�<=6�%(Rr687p)?%@=9(6K7NHJ4*@=9�$&%('3)?+1%d>,+-%(214(+1216�7G+1%('�q])?%('*) W � >O>0@=93687N6^R�+-%�`56`(<=),'*2168'd`\Ad7N)?Z/[3>?6+1'('*)}@E)OHJ%(+->t%3H-@L+a@=)?H1%s)?%�q])?%('*) WUXG936�<E6�7=43>}@E)O%(2U>?+1%3214(+1216_R"+1%s`56�:P)?6"F 6�'s+17K+7=H14*@E936"<E%d'3)?+1>O68Rk@]H-B�q])?%('*) W � %\457=+1<E+1�;+#4(7=6�7G@E93),7]'*),+->?6�Rk@G@EH_Z/+1�167=H143<LRr6i@=6"VP@)?%�7=H143@=936�<=%d>?+1%32145+-21687G+1R"R"6�7E7N)?`3>?6Y@EH�q])?%('*)�<E6�+J'*6"<L7�W

��� �e� �k�8�)�;�;� ¥ � � � � ��1� �k� � �L£L� *

Page 119: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,� �%*!����� ������ �� �� ��%'� !P��� �K� � ���=� � �� v � � <>= <@? � G�� � ��B ��J� �XG936S[3<=HJ`3>?6"Z `56�)O%32�+1'3'3<=687=7=6�'�936�<=6S)?7t93HaF @=H^Ha:J6"<LRrHJZ�6G@E936Y>,+-%(214(+1216Q`(+1<=<E)O6�<)?%y$&%('*),+3W {343>?>OA\f&+-4*@EH1Z_+a@E)?R�2J6"%36�<E+1>}fl[343<E[eHJ7=6d9()O2J9*flc\4(+1>O)O@�A�Z_+1RL9()O%36�@=<L+-%(7=>?+-f@=)?H1% 7=A*7�@E6"Z_7_��{��CqQf X�X BDHJ<^7N9(H1<=@L�C+-<E6�6rVP@=<E6"Z/6">?A~'3)}��Rr4(>}@@EHU`343)?>?'�W�XG936"<E6+-<E6K%(H�6"VP),7N@=)?%32b@E<E+1%(7=>?+-@=)?H1%�7=AP7N@=6�Z_7YBDHJ<+-%PA�[(+-)?<SH1Bt>,+-%32J4(+-2J6�7])?%~@=936�FIHJ<=>,'@=95+a@Yc\4(+->?)OBDA_@=H/`e6CR�+->?>O68'�{��CqQf X�XCW(XG936'*)O��Rr43>O@�A�+1<=),7=6�7IBD<=HJZ�@=936CBDHJ>O>?HaFQ)?%32<E6�+17=H1%57"uv WQ$&%�+-%PA/%(+-@=43<L+->�>,+-%32J4(+-2J6Q@=6"V\@8n*H1%3>?A_[(+1<N@ H-B�@E936C)O%*BDHJ<=Z_+-@=)?H1%_@EH#`e6RrH1%3f:16"AJ6�'�)?7]6rV*[3>?)?R")}@E>OA�6rV*[3<E6�7E7N68'�+1%('d)}@]),7G@=9(6^9P43Z_+-%�Z/)O%('�FQ9()?RL9dT(>?>?7]43[@=936/'*6r@L+-)?>?7C`PAU4(7=)?%32b@E936�FIHJ<=>,'��P%3HaFQ>?6�'*2J61W^XG936�`(+J7N),RK<E6�+J7NHJ%UBDH1<i@E93)?77�@L+a@=6#H-BG+a��+-)?<E7S)?7S@E9(+a@i@=936/RrHJ%(Rr6�[*@E7C+1%('�7=9(+1'36�7iFQ93),RL9~+�%5+a@=4(<E+1> >,+-%3f214(+1216G[343<E[5HJ<N@L7�@EHK'*6�7ERr<E)?`56QBDHJ<=Z�+^R"H1%\@=)?%P4343Z�+-%('�@E936]%P43ZK`e6"<IH-B�>?6rV*)}fR"+->\)O@=6"Z_7�+;:a+-)?>,+-`3>?6I+1<=6tT(%3)O@=61n\7NHS%36�R"6�7E7=+1<=)?>?AS@E936"AK9(+;:16t@=Hi`56GHa:16�<=>?HJ+J'*6�'+-%('�)O@t)?7pH1%3>?A#`e6�R�+-4(7=6QH-Be@=9(6Q@=H1@E+->5RrH1%\@E6rVP@I+-%5'�7=9(+1<=68'K`(+JRL�P21<EH143%('#43%*f'*6"<L7�@L+-%('3)O%32�@=95+a@^F 6�+-<E6�+1`3>O6�@EH�'*)?7E+-Z#`3)?214(+-@=6�@=936�Z +1%('~+1<=6_+1`3>O6�@EHRrH1Z/Z#43%3),R"+a@E61Wz W�ZY)O�e6�<=6�%\@�%(+a@E43<E+1>->,+-%32J4(+-2J6�7�+1'3H1[*@0'*)O��6"<E6"%\@mRrHJ%P:16"%\@E)OHJ%(7�+-`eH14*@�@E936�@�AP[e6+-%(' +-Z/HJ43%\@�H-B)O%3BDH1<EZ/+-@=)?H1%w@=H `56�457N68'�W�XG9(6�<=68+17=H1%(7�BDHJ<_@=9()?7bZ/+;A`56JuK@E936�93),7�@EH1<EA�H1BG>,+-%(214(+1216_'*6":J6">?H1[3Z/6�%J@d��'*)O�e6�<=)?%32U@L+17N@=687"n�+-<E`3)O@=<L+-<EARL93H1),Rr687YZ_+1'36�)?%~@=936/>?H1%32d93),7�@EH1<EAdH1BI>,+-%32J4(+-2J61n�[3<E6�7=6"%(R"6#H1BIH1@=936�<i>,+-%3f214(+1216�7I+-%('�Z/)}V*)?%32�FQ)}@E9b@E936"Z�n*6r@LR-W���+-%('�@=936C6"%P:P),7=+1216�'�[3<=)?Z_+-<EA�BD43%(Rkf@=)?H1%dH-B @=936>,+-%32J4(+-2J6S6"@ER1WXG936 %36r@�<E6�7=43>O@ H1B(@=9()?7�),7m@=9(+-@�4(%3>O687=7 F 6I[(<=Ha:P),'*6IZ_+JRL93)O%(6�7mFQ)}@E9#�P%3HaFQ>?6�'*2J6+-%5'�)?%*BD6"<E<=)?%32�R"+-[5+-`3)?>O)O@�A�RrHJZ/[(+-<L+-`3>?6Q@EH#9P43Z_+-%�`56�)O%(2J7G{��Cq]f X�X FQ)O>?>�%3H-@G`e6BD6�+J7N)?`3>?61W#$l@CFQ)?>?>�%3H-@C`56�+1%�6"V*+1212J6"<L+a@=)?H1%�@EHd7E+;A�@=95+a@)O%57N[3)O@=6/H1Bt@=<E6"Z/6�%('*H1457[3<EH12J<=687=7i)?%�RrH1Z/[343@=6"<^@=6�RL9(%3H1>?H12JA��DZ_+-)?%3>?A~)?%h@=6"<EZ_7H-B]7=[56�6�'�n Z/6"Z/H1<EA�+1%('[3<EH12J<E+1Z�Z/)?%32K6�%P:\)?<EH1%3Z/6"%\@L7E� {��Cq]f X�X <E6"Z_+-)?%(7Q+/'*),7�@L+-%\@]'*<E6�+-Z�W

<>= <>= M J Q Q,D�� Q,N�� ��B��D@G A ��TQ$&%U7N[()}@E6^H-B @=936#'*)}��R"43>}@�A�H-B�{��Cq]f X�XCn5)}@YR�+-%�`e6KRr>,+-)?Z/6�'�@=9(+-@]FQ)}@E9�@=936K936">?[H-BQZ_+1RL9()O%3687"nm@=9(6b>,+-%32J4(+-2J6�`5+-<E<=)?6"<KR�+-%s`e6bHa:16�<ER"H1Z/6�@=H*'3+;AJWd$lBG@E93)?7�7=H143%('(7[(+1<E+J'*H;V*)?R�+->*>?6r@I457tRrHJ%(7=)?'*6�<I+1%�+-%(+1>OHJ21A1W��*Rr)?6"%\@E)?7N@E7t6":16�%/@=H*'3+;A/+-<E6Y7N@=<E43212J>O)?%32@=H#`343)?>?'�+^Z_+1RL9()O%36S@=95+a@ R�+-%�FG+->?�/>O)?�16i+^9P43Z_+-%0nP+;:JH1),'*)?%32^H1`57�@L+1Rr>?6�7p@=H#<=68+1RL9+'*687�@E)O%(+-@=)?H1%�W � @p@E936Y7E+-Z/6G@=)?Z/61n\FI6Q9(+;:J6G`56�6"%�7=4(R"R"6�7E7�BD43>?>?AK4(7=)O%(2<E+1)O>*@E<E+1%(7Nf[eH1<=@pBDH1<pZ/HJ<=6Q@E9(+-%�+R"6"%\@=4(<=AJW�XG9(6Y'*),7�@L+-%(R"6]`(+-<E<E)O6�<�9(+17�`e6"6�%�Ha:16�<ER"H1Z/6G6":J6"%FQ)O@=93HJ4*@Q@=936Z_+JRL93)O%(6�7G>?6�+-<E%3)?%32#@=H_FG+->?�eWXm<=436Jn0BDHJ<^@E93)?7KFI6b9(+;:16_9(+J'h@=H�>,+;A�<L+-)?>?F +;AU@E<E+JRL�*7^+->?>tHa:J6"<C@=9(6�RrHJ43%\@=<EA�M`343)?>,' `3<E),'*21687�+JRr<EHJ7E7�<E)O:J6"<L7"M^'*)?2�@=43%3%(6">,7b@E93<EH1432J9 Z/H143%\@L+-)?%(7�+-%(' `343)?>?' +9P43216Q)?%*BD<L+af&7�@E<=45Rk@=4(<=6 @=HKZ/+1�16G@E936]FQ93HJ>O6G@E93)O%(2BD6�+J7N)?`3>?61W�op:16�%�@=936�%_)}@I'36">?)O:J6"<L7@=9(6�2JH\H*'37#+-%('�[(+17E7N6�%3216�<E7K+a@#HJ%3>?A~@E936d<E+1)O>?F +;Ah7�@L+a@E)OHJ%(7"MtFI6�%36"68' 7=6"[(+1<E+-@=6

Page 120: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v �%# ���������� � � � � ���$&%��� ��% ��� ��P$]��%

+-<E<L+-%32J6"Z/6"%\@E7#@EH 216r@b@=936�@E93)O%(2J7b+1%('w[56�<E7=H1%57�+a@�93HJZ/6 �CW 4*@d+->?>Y7=+1)?' +1%(''*HJ%361n*)O@Y'*HP6�7Q6�%(+-`(>O6C4(7G@EH/Ha:16"<LRrHJZ/6]@=9(6^'*)?7N@E+1%(Rr6`5+-<E<=)?6"<8W$lB {��CqQf X�Xy),7G>O)?�16S@=9(6iFG+->?�P)O%(2#Z_+1RL9()O%36Jn*FQ9(+a@G),7 @=936RrHJ43%\@=6�<=[(+1<N@I@=H�@=9(6<L+-)?>OFG+;A/>OH*RrHJZ/H-@=)?:16 ��XG936+-%(7=F 6"< >O)?6�7G)?%U7N6�[(+-<L+a@E)O%32#>?+1%32145+-216"f `5+17=6�'_+-%5+->?AP7=),7H-BI@=6"V\@8n�BD<EH1Z|�P%3HaFQ>?6�'3216/+-%('~)O%3BD6"<E6"%(R"6rfl`(+17=6�'~+-%(+1>OA*7=)?7�W#XG936�BDHJ<=Z/6"<C@L+17=�U)?7>?6rB @�@=H~@=936dZ_+1RL93)?%361np+1%(' @E936d>?+-@N@=6�<K@L+17=�h@=H�@E936d9\4(Z/+1% <E6�+J'*6"<#`568R"+-457N6�H-B@=9(6")?<#[3<EH-TeRr)?6"%(R"A~BDHJ<^@E936�<E6�7=[e6�Rk@E)O:J6�@L+17=�P7�W�gh6�+->,7NH�<E6">,+aVh@=9(6�<E6�c\43)?<=6�Z/6"%\@@=95+a@]@E936H14*@E[34*@Y`e6^2J<E+1Z�Z_+-@=),R"+-> W�gh6K'*H_<E6�c\43)?<=6Jn393HaF 6":16�<�n\@E9(+a@]@E936^HJ4*@=[343@`e6�R"H1Z/[3<E6"936�%(7=)O`3>?61W � [(+1<N@/BD<EH1Z @=9(6d6"�eHJ<N@�@=Hs`34()O>,'�+1[3[3<EH1[3<E),+a@=6�ZK43>O@=)?>?)O%*f2145+->m'(+a@E+1`(+17=6�7QBD<=HJZ�+�R"H1Z/[34*@L+a@E)OHJ%(+->m:\)?6"FQ[eH1)?%\@�n�Rr<E6�+-@=)?:16),'*6�+J7Y+-<E6^%36�6�'*68'@=H�6�7N@E+-`(>O),7N9 >,+-%(214(+1216_`3<E)?'3216�7�WUXG93H14(219h@=93),7#)?7#RL9(+->?>O6�%321)?%325nm)O@K),7#'*6"T(%3)O@=6�>OABD6�+J7N)?`3>?61W�gy)O@=9d@=936+1[3[3<EH1[3<E)?+-@=6i)O%3BD<E+-fl7N@=<E4(Rk@E43<E61nJ@=936>,+-%32J4(+-2J6Y`(+1<=<E)?6"<GR"+-%d`e6Ha:16�<ER"H1Z/6YFQ)O@=9d@EHP'(+;A + 7 @=68RL93%3HJ>OHJ21A�+a@]>?6�+J7�@]+1Z�HJ%32#@=936$&%('3)?+1%d>,+-%(214(+1216�7�W <>= <�� �ON�� � B � � ����XG936U[3<L+1Rr@=),R"+1>G+J7N[e6�Rr@�H-BS@=93),7_[3<EH1`3>?6"Z )?7/@EH '*)O:P),'*6�@=9(6U>OH\+1'�`56"@�FI6�6"%wZ/+1%+-%5' Z/+JRL93)?%36�)?% 7=4(RL9 + FG+;A @E9(+a@�@=936h+17=[568Rk@E7bFQ93),RL9 +-<E6�'*)O�_R"43>O@�BDHJ<�@=9(69P43Z_+-%�`e6")?%32�+-<E6^9(+1%('*>?6�'�`PAd@=9(6KZ_+1RL93)?%36Jn�+1%('�+J7N[e6�Rr@E7SFQ93)?RL9h+-<E6^6�+J7NAdBDHJ<@=9(6K9P43Z_+-%U`e6")?%32�+1<=6>?6rB @S@=H�9()OZ�WYXG936�+-)?Z ),7Q@EH�Z/)O%()OZ/)��"6^@E936K6"�eHJ<N@SH-B�@=9(69P43Z_+-%d`56�)O%(2(WXG936Q+-[([3<=H\+1RL9�n;93HaF 6":J6"<8naR"+-%�%3H1@�`e6]+i936�+;:PA\fl9(+-%('36�'Z/6r@E93H*'�`568R"+-457N6 @=9(6[3<EH1`3>?6"Z )?7:J6"<EA�RrHJZ�[(>O6"V�W � `(<=4*@E6�BDH1<LRr6_7NHJ>O43@=)?H1%hFQ)O>?>p6")O@=9(6"<^`3>?HaF 4([s+J7C+<E6�7=43>}@QH1Bm@E936>?+1<=2J6i+1Z/H143%\@]H-B <=687NHJ43<LRr6�7 )O@]FQ)O>?>�%36�6�'�n(H1<G@=9(6>?+1<=2J6i+1Z�HJ43%\@QH-B@=)?Z/6#)O@CFQ)O>?> @E+-�J61W � %3H1@=936�<i'36�7=)O<L+-`3>?6^BD68+a@E43<=6#H-Bp@E936/+-[3[3<EHJ+JRL9UFIHJ43>,'U`56#@=9(66�+J7N6�FQ)}@E9�FQ9()?RL9 @E936U7NA*7N@=6�Z R�+-%�`56d6rVP@=6�%('*68' @=HhH-@E936"</<E6">,+a@E6�' >,+-%32J4(+-2J6�7�WXG936�7=A*7�@E6"Z ),7/>O)?�16�>OA�@=Hs[5H\7=7=6�7E7/6r��R")O6�%(RrAJnI6"V\@E6"%(7=)?`3)O>?)O@�A1n 6r@ER1W H1%3>?A�)OBi)O@�)?7`(+J7N68'bHJ%d7=H143%5'�[(<=)?%(Rr)?[3>?6�7Q+1%('�@E936"HJ<=AJWXG936�H1<E6r@=),R"+1>1),7=7=43687mH1B()?%J@E6"<E6�7N@ <E6">,+a@E6p@EHS)?%*BDH1<EZ_+a@E)OHJ%#+-%5'^93HaF )O@�)?7�RrH*'*68'^)?%>,+-%32J4(+-2J61WmqYHaF )?7p@=936S)O%*BDHJ<=Z_+-@=)?H1%_6rVP@E<E+JRk@=68'�� � <E6">,+a@E6�'_c\436�7N@=)?H1%_),7IFQ9\A#@=9(67E+-Z/6K+-Z/HJ43%\@]H-Bp7N4(<NB�+JRr6)?%*BDH1<EZ_+a@=)?H1%U)?%UH1%(6^>?+1%32145+-216C),7YR">O68+-<E>OA�43%('*6�<E7N@=HPH*'FQ93)?>O6~)O% +-%3H1@=936�<�>?+1%32145+-216JnG)}@d)?7�%3H-@dRr>?6�+-<b@=H @E936�<E6�+J'*6"<8W gy9(+a@�+-<E6U@=9(67=H143<LRr687IH1B0�P%3HaFQ>?6�'*2J6Y@E9(+a@]+-<E6i4(7N68'b)?%�)O%3BDH1<EZ/+-@=)?H1%�6rVP@=<L+1Rr@=)?H1% ��qYHaF 7N9(H143>,'@=9(6�\%(HaFQ>O68'*216i`56HJ<=2\+-%3)��"68'��� >O@=9(H1432J9U@=936/RrHJ%(Rr6�[*@SH1Bt+-%P4(7E+-<L+-�a+/),7Y2J6"%36�<E+1>�neFI6#FQ)O>?>�'*)?7ERr457=7S)}@C)?%�@=9(6RrHJ%\@=6rVP@YH1Bp$&%('*),+-%�>,+-%(214(+1216�7�u FQ)}@E9�<=687N[e6�Rr@Y@EH "+-%(%(+1'3+-flqY)O%5'*)0+-%P4(7E+-<L+-�a+/)?%[(+1<N@E)?R"43>?+1<�W <>= < ; ��Q�BEJ�� Q,J�B�� � � � �JR G�B,G��#G�� F�R Q ���

�\@E<=4(Rr@=43<E6�H-B]@E936U+-%P4(7E+-<L+-�a+U),7_7N9(HaFQ% )?%w{ )?2143<E6 �*W v W � 7NHJ43<ER"6�>,+-%(214(+12167=6"%\@=6�%(Rr6C),7 T(<E7N@Q[3<EHPR"6�7E7N68'_`PA�Z/H1<E[393HJ>OHJ21),R"+->�+-%5+->?A ��6"<�DZ/HJ<=[39e�kW�XG936Z/H1<E[39RrHJ%(7=)?'*6�<E7�+^FIHJ<E'�+a@I+i@E)OZ/6JnP+1%('#BDH1<p68+1RL9/F H1<L'#)O@IRL9368RL�*7�FQ936r@E936"<p@=936SFIHJ<E'#)?7

Page 121: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,� �%*!����� ������ �� �� ��%'� !P��� �K� � ���=� � �� v � ª�

��+1<E+J'*)O2JZ_7.�6"VZS6rB�+143>}@ �I93H1),Rr687

X � X��� +J7N6"fl��+1<E7E+-<E2 ZS+-@E+�i<EH143[()O%32 UQ43>?6�7

W )O>?)O%(214(+1> ZY),Rk@E)OHJ%(+-<EA�Y)?`39(+1�J@E) ZS)?Rr@=)?H1%(+1<=AX � X ZY),Rk@E)OHJ%(+-<EA

X +-<E216"@G.m+-%325WX � X ZS6r@E+1)O>,7

��+-<L+1'*)?21Z_7i� �YH143%�n��6"<E`�n(�t<=HJ%3H143%0n*�*9(+17=9\@=) �

ZS6rB�+143>}@ �I93H1),Rr687

qYo ��UQ$N�*XG$ �U��Y.moI�

�� � �Z qY$ � � � " � �Co� �

X � UY�tq

�.Jg �

X � �t�t$ ���1W . � � "

�.Jg �

�Co � � XUHJ<=[39U�PAP%\@=93687N)��"6�<L�

�� �SXQ� �SX� ���YX � � XG$ � � ��� � U

� � � �i� � U � " � %*f >?)?%36^q]6�>O[�

{ )O2J43<E6 �*W v uGu3WI>?H*RL���*RL936�Z_+a@=),RiH-B � %P4(7E+-<L+-�a+

Page 122: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v1v � ���������� � � � � ���$&%��� ��% ��� ��P$]��%

)?%_@=936S'*)?Rr@=)?H1%(+1<=A�H-B�)?%('*68Rr>?)O%(+1`3>?6]FIHJ<E'(7"W $lB�BDH143%('�n\)O@I<E6r@E43<E%(7�)O@E7I21<L+-Z/Z_+a@=),R"+1>BD6�+-@=43<E6�7�W�$l@K+1>?7=H�4(7N687C@=9(6_FIHJ<E'~[(+-<L+1'3)O2JZ/7S@EH�7N6�6_FQ936r@E936"<@E936_)?%3[34*@KF H1<L'R"+1%#`e6]'*6�<=)?:168'BD<EH1Z +i<EHPH-@�+-%('#)}@L7�[(+1<E+J'*)O2JZ�W0$lBe@=936Q'*6�<=)?:a+a@=)?H1%�),7�[5H\7=7=)O`(>O6Jn1)O@<E6r@=4(<=%(7 @E936^2J<E+1Z�Z_+-@=),R"+->eBD68+a@=4(<=687Q+17E7NH*Rr),+a@E6�'�FQ)}@E9d@=936^F H1<L'_BDHJ<=Z �DHJ`*@E+1)O%368'BD<EH1Z @=936I<=HPH-@ +-%('i@E936t[(+1<E+J'*)?21Z��kW�$&%^R�+17=61n8@=9(6p)O%([34*@�FIHJ<E'CR"+1%3%3H1@0`56 '*6"<E)?:16�'�n)O@])?7G[eHJ7E7N)?`3>?Ab+_RrHJZ/[5HJ43%('�FIHJ<E'�+-%('d),7G21)?:16"%�@=H�@E936^7=+1%('*93)�[5+1RL�a+-2J6Y@EH�7N[3>?)O@)O@])O%\@=H�@�F H/H1<QZ/H1<E6CFIHJ<E'37�nPFQ93),RL9�+1<=6S@=9(6"%U+-2\+-)?%d+1%(+->?A �"6�'b`PAbZ/H1<E[39�WXG936/H143@=[34*@^H1BIZ/H1<E[39h)?7C2J)O:J6"%s+17i)?%3[34*@@EH�@=936/>?HPR�+->�F H1<L'�2J<=HJ43[56�<�W�$l@E7Z_+-)?%/@E+J7N�#)?7p@=H21<EH14([#BD4(%(Rk@E)OHJ%_FIHJ<E'37pFQ)}@E9/@=936YR"H1%\@=6�%\@pFIHJ<E'37p`(+17=6�'�H1%_>?H*R"+1>)?%*BDH1<EZ_+a@=)?H1%~7N4(RL9h+17S[5H\7�@E[5H\7N)O@=)?H1%~Z_+-<E�16"<L7Q@E9(+a@CBDHJ>O>?HaF +�%3HJ43%�n�HJ<C+14*V*)O>?),+-<EA:16�<=`57�BDH1>?>OHaFQ)?%32�+sZ_+-)?% :16"<E`�W�XG93)?7b21<EH143[()O%32y��H1<bR�+17=6d6�%('*)?%32J7b)O%yR�+17=6UH-B)?%�\(6�Rr@=)?H1%(+1>P>?+1%3214(+121687E�rn8),'*6�%J@E)}T56�7 :P)O`395+-�\@=)*H1B(%3H14(%(7�+-%('K:16"<E`(7�WmXG936 :P)O`(9(+-�\@=)H-B�:16�<=`57I),7]+1>?7=H�R�+->?>O68'�X � X �D@=6"%57N6"fl+J7N[e6�Rr@NflZ�H*'3+1>O)O@�A3�I>?+1`56�>�W� B @E6"<�@E936t+1`5Ha:J6�7N@E+1216Jn�7=6"%\@=6�%J@E)?+1>1+-%5+->?AP7=),7�R"+-%C`e6t'*HJ%361W �I43<=<E6"%\@�+-%P4(7E+-<L+-�a+'*HP6�7K%3H-@�'*H�@=93),7K+1%(+->?A*7N),7`e6�R�+-4(7=6�)O@K<=68c\43)O<E6�7K+�>?+1<=2J6�+-Z/H143%\@^H1BG>?)?%32143),7N@=),R'3+-@E+/@EH�`56#[3<E6"[(+1<=68'�W � >?7=H(n�7=)O%(R"6@=9(6K$&%('*),+-%U>,+-%(214(+1216�7Q+1<=6#Rr>?HJ7=61n3@E936 # � f z��<E43>O6�+-[3[3>?)?6�7@EH�:P)O`(9(+-�\@=) W �Y7=6�H1BG:P)?`39(+1�J@E)t[3<EH*'*4(R"6�7 # ��� �=R"H1<E<=68Rk@ �dHJ4*@=[343@FQ)O@=9�HJ%3>OA z���� 6"�eHJ<N@8W �P6"%\@E6"%\@=),+->I[(+-<L7N6�<^R"+1% `56�)O%(R"H1<E[5HJ<E+-@=68'�FQ936�%�>,+-<E216>?6rV*)?R�+->�'3+-@E+1`(+17=6�7G+-<E6C<=68+1'*AJWXG936#%36rVP@7�@L+-216#H-Bp[3<EH*Rr687=7=)O%(2b),7]@E9(+a@CH-Bp@E936�Z/+1[3[3)?%32b`(>OH*RL��WiXG9()?7C7N@E+-2J64(7=6�7]+/%(H143%�:P)O`(9(+-�\@=)m'*)?Rr@=)?H1%(+1<=AJn3+_X � X '*),Rk@=)?H1%5+-<EA1n(+1%('�+#`()O>?)O%(214(+1>0'*),Rk@=)?H-f%(+1<=AJWC{(H1<C6�+JRL9�F H1<L'U21<EH143[0n(@E936_7NA*7N@=6"Z T5%('37C+b7=43)O@E+-`(>O6�<=HPH1@i+-%5'�:P)O`(9(+-�\@=))?%b@E936C@E+1<=2J6r@G>?+1%3214(+1216JW XG9P4(7�n*)}@Q2J6"%36�<E+-@=6�7G+#>OH*R�+->�F H1<L'_21<EH143[�)O%d@E936i@E+-<E216"@>,+-%32J4(+-2J61WXG936�>?HPR�+->GF H1<L'�21<EH14([(7�)O%�@=936�@L+-<E216"@�>,+-%32J4(+-2J6d+1<=6d[(+J7=7=6�' H1%�@=H +h>OH1fR"+1>IF H1<L'�7=[3>?)}@=@=6"<U��.1g �3�KBDHJ>O>?HaFI68' `PA�+�Z/H1<E[393HJ>OHJ21),R"+1>I7=A\%\@E936�7=)���6"<d� �Co �i�kW.Jg ��7N[3>?)O@E7G@E936^>?HPR�+->�F H1<L'd21<EH143[57G)O%\@=H_6�>O6�Z/6"%\@E7]R"H1%(7=),7�@E)O%32_H1B <EHPH-@Y+1%('dBD6�+-f@=4(<=687"WU{ )O%5+->?>OAJn �Co � 2J6"%36�<E+-@=6�7i@E936bF H1<L'37CBD<EH1Z +�<EH\H1@#+-%5'h@=936b+J7=7=H*Rr),+a@E6�'21<L+-Z/Z_+a@E)?R�+->eBD6�+-@=43<E6�7�W <>= < � � R � B �� Q � B � G � �� %P4(7E+-<L+-�a+HJ4*@=[(4*@I),7t457N4(+1>O>?A/%3H-@I@=936S@E+1<=2J6r@t>,+-%(214(+12161nJ`34*@QRr>?HJ7=6]@EHK)O@�W�XG9P4(7"n@=9(6 "+-%(%(+1'3+-flqY)O%5'*)p+-%P4(7E+-<L+-�a+d[3<EHP'34(Rr687K+U'*),+->?6�Rr@KH-B]q])?%('*) n�@=95+a@#'*HP687^%3H1@9(+;:J6#+-2J<=6�6"Z/6"%\@Y6"@ER1W$l@CR�+-%�`e6�R�+->?>O68'�+�7NHJ<N@iH-B Zi+-�*7=93)O%()G��7NHJ4*@=9(6"<E%5�]qY)O%('3)�W�PHJZ�6C+1'('*)}@E)OHJ%(+->�%3H1@E+-@=)?H1%bZ_+;A_+->,7=H#`e6S457N68'b)?%�@E936CH14*@E[34*@�W �I6�<N@L+-)?%�+1Z�HJ43%\@H-BP@E<E+1)O%3)?%32]),7�%(6"6�'36�'iBDH1< +Q4(7=6"<0@=H]2J6r@04(7=6�'i@EHQ@=9(6I+-%P4(7E+-<L+-�a+ H143@=[34*@ >?+1%32145+-216JWXG936<EH1>?6H-B @=936#+-%P4(7E+-<L+-�a+K)?%\@=6�<NB�+JRr6��DHJ<]H1%3f >?)O%(6936">?[U)O%�{ )?2143<E6 �PW z � ),7G@EHB�+1R")O>?)O@E+a@E6Y@E936i<=68+1'*)?%32KH1B�H14*@E[34*@Q`PA�@=936i<=68+1'*6�<�W $l@Q7N93HJ43>,'��16�6"[_@E<E+JRL�#H1B0FQ9(+-@RrHJ%(Rr6�[*@E7^9(+;:16_`e6"6�% )O%\@=<EH*'*4(R"6�'~@=HU@E936�4(7=6"<8n�+-%('s+->,7=HU[3<=Ha:P),'*6_H1%3f >?)O%(6_936">?[FQ936�%�@E9364(7=6"<GB�+JRr6�7Q+�[3<EH1`(>O6�ZdW

��� � ���C�)�;� ¥ � � � ×]�E��¥#� � �E�� � ¥ � ¥ � ��¥ � � � �L¤ ( � �.� ¥ � &0� ¤�¤ � × ( � ��� ¥K� � ¥ ( ¥ ���?�k� ×]� �;� ¥ �k� ¤ �×]� �  k��� �L¤�¤ � �?�k� � � � �1� ¤ �E� ���8  �?��� × ���)� � ��� �1�;� � � ¤ � �; )� �   ¥ � � � � ���-�;� *

Page 123: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,� �%*!����� ������ �� �� ��%'� !P��� �K� � ���=� � �� v1vJv

�Y7=6"<E$&%\@=6�<NB�+JRr6

X + X�� X��E+ X +-<E216"@Q.m+-%325W X +-<E216r@].m+-%325WX Xq � X�X X�X�p+-<E)?H14(7G.�6�:16�>?7GH1B � %\457=+1<E+1�;+� 4*@E[34*@

�D@=H_9P43Z_+-%<E6�+J'*6"<L7E��

X +$&%\@E6">?>O)?216�%J@ �S7N6�<Q$&%J@E6"<=B�+1R"6X +

9\4(Z/+1%+-),'

q � X�XX +

� 4*@=HJZ_+a@=),R �IH1<E<=68Rk@EH1<X +

�IH1<E6 � %P4(7=+1<E+1�a+�

�*H143<LRr6.0+1%32145+-216

� � � �

{ )?2143<E6 �PW z uGu3ZY)O��6"<E6"%\@]$&%\@=6"<=B�+1R"6�7 BDHJ< � %P4(7E+-<L+-�a+

ZS6"[e6"%('*)?%32hH1% @E936d%(+a@E43<=6�H-B])?%\@=6"<=B�+1R"61n�HJ%36�R�+-%�9(+;:J6�+1%�H1<L'*)?%(+-<EA~457N6�<)?%J@E6"<=B�+1R"61n\)O%\@=6�>O>?)?216"%\@t457N6�<I)?%\@=6"<=B�+1R"61n\212\q � X�X���9P43Z_+-%b+1)?'*68'_Z_+1RL93)?%36Q@E<E+1%(7Nf>,+a@=)?H1%e�kn(+1%('bZ_+JRL93)O%(6S@E<E+1%(7=>?+-@=)?H1%s��7=6"6{ )O2J43<=6 �*W z �kW <>= <�� �VD���JD R[Q,D � � B � GXG936�<E6�+J7NHJ%�@E936b+1`5Ha:J6�+-[3[3<EHJ+JRL9�F H1<E�*7CBDH1<^$&%5'*)?+1% >?+1%32145+-21687i6":16�% FQ)}@E93H143@+�BD43>O>�\(68'*2168'�[(+1<E7=6"<�),7K@E9(+a@�@=9(6�7=H14(<ER"6b+-%('�@E+1<=2J6r@/>?+1%3214(+121687K+-<E6�7=)?Z�)?>,+-<8W� @]Z_+-[3[()O%32_>?6":J6"> n3)O@])?7Q[eHJ7E7=)O`3>?6C@=H/T5%('d<=HPH-@L7"n5X � X�7"n5+-%('d%3HJ43%�:\)?`39(+1�\@=)�)?%q])?%('*)�BD<=HJZ +-%d6�c\43)?:a+->?6"%\@�"+-%3%5+1'3+K@=6"V\@]FQ)O@=9(H14*@Q@EH\H_Z_+1%\A�Rr>,+17=936�7�W

WG+17=6�'dH1%UHJ43<]6"VP[e6"<E)?6"%(R"61n(F 6^R"+1%�7=+;Ab@=9(+-@S+-[5+-<=@QBD<=HJZ�+121<E6"6"Z/6�%J@8n*@=9(6"<E6+-<E6CH1%3>?A y Z_+:(�HJ<G'3)}��6"<E6"%(R"6�7G)?%d@=936^7=H14*@E9�$&%('*),+-%d>?+1%3214(+121687IFQ)O@=9UqY)O%('3)�W � >O>@=9(6�7=6CR�+-%�)O%�B�+1Rr@G`e6C`3<E)?'*2J6�'�W�XG936�Ab+-<E6S'36�7ERr<E)O`e6�'�`56�>OHaF BDH1< "+-%3%5+1'3+-flqY)O%('3)

Page 124: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v1v;z ���������� � � � � ���$&%��� ��% ��� ��P$]��%

+-%P4(7E+-<L+-�a+(W#W 4*@QT(<L7�@]>?6r@]457G>OHPH1��+a@]+-2J<=6�6"Z/6"%\@�W <>= < D���D �� J�L ���3B � ��� � Q�D � �JR G�B,G��#G���J�Q�L�J Qq])?%('*)09(+17Q+1%�+121<E6"6�Z�6�%\@ <E43>?6iFQ9()?RL9UR"+1%�`e6^7N@E+a@E6�'d+17 BDHJ>O>?HaF]7"u

�i6"%5'*6"</%P43ZK`e6"<_[e6"<L7=H1% �D21%([5�#H-BY@E936U:16�<=`w+-2J<=6�6�7#FQ)}@E9�@E936U21%([�H1BY@=9(6�a+-<=@E+�)}BG)O@C95+17 � :P)?`39(+-�\@E) #1n�H-@E936"<EFQ)?7=6#@=936_2J%3[~H1Bt@E936/:16"<E`~+121<E6"687YFQ)O@=9h@=9(6�a+-<EZ_+U)}BS)}@�9(+17 ��:\)?`39(+1�\@=) MtH-@E936"<EFQ),7N6_@E936b:J6"<E` @E+1�1687^Z_+17ERr43>?)?%361n�7=)O%32J43>,+-<8n@=9()O<L'd[56�<E7=H1%�BDH1<EZ�Wgy936�%^@=9(6I)?%3[34*@ "+1%3%(+1'(+Y7=6"%\@=6�%(Rr6I9(+17�+-%#+-ZK`()O2J43)}@�A)?%K),'*6�%J@E)}BDAP)?%32i�;+1<N@L+�DHJ<b�a+-<EZ_+sFQ93),RL936":J6"<�),7�<E6">?6":a+-%\@�BDHJ<�+121<E6"6"Z/6�%J@k�/+-%('w@E936�2J%3[yH-BC@E936�@�F HR"+1%('*),'3+a@E6#�a+1<N@L+17��DH1<C�a+-<EZ_+17L�Q),7C'*)}��6"<E6"%\@8n�+-%~+1ZK`3)?214()}@�A�FQ)?>O>p+1[3[568+-<i)O%~@=9(621%([�H1Bm@E936:16�<=`�W�P)?Z/)O>,+-<E>OAJn([eHJ7E7N687=7=)?:16Z/H*'*)}T56"<L7]H-B�%3HJ43%(7Y%36"68'U)O%3BDH1<EZ/+-@=)?H1%�+1`5HJ4*@Y21%([UH-B@=9(6d<E6">,+a@E6�' %3H143%57"W XG9(6"<E6d+1<=6�+�%P43Z#`56�<_H-BSR�+17=6�7�FQ936�<=6d)}@_),7�%3H-@_6�+J7NAh@EHRrHJZ/[34*@=6JWp�PH1Z/6r@E)OZ/687"n\@=9(6S<E6">?6":a+-%\@ )O%*BDHJ<=Z_+-@=)?H1%_Z_+;A/%3H-@ 6":16�%�`e6i+;:a+-)?>,+-`3>?61W @"+-%(%(+1'3+�9(+17]@=93<E6"6�216�%('*6"<L7K��Z_+17ERr43>?)O%(61neBD6"Z/)?%3)O%(6/+1%('U%36�4*@=6�<L�rn�FQ936"<E6�+J7q])?%('*)59(+17�HJ%3>?A^@�F H/��Z_+17ERr43>?)O%(6]+-%('#BD6"Z/)?%3)?%368�rW �IHJ%(7=6�c\436"%\@E>OAJnJ7=H1Z/6G)O%*BDHJ<=Z_+-f@=)?H1%�>?HJ7E7 )?7Q`eH14(%('�@=H/H*R"Rr4(<Q)O%�21HJ)O%(2KBD<EH1Z "+1%3%(+J'3+#@=H_q])?%('*) WtXmH/+;:JH1),'_@E93)?7>?HJ7E7"nP)O@GFQ)?>?>�`56C%368Rr6�7E7E+-<EAK@EH�[(<=Ha:P),'*6S+J'3'*)O@=)?H1%(+1>e%(H-@E+-@=)?H1%b@=H/Z_+-<E�#@E936C%36"43@=6"<216�%('*6�<�W�q]6�<=6C),7]+-%d6rV3+1Z�[(>O6i@=H_2J)O:J6S)O@E7Y7N)?21%3)OT5R�+-%(R"61u$&% q])?%('*) nQBDHJ<��a+-<EZ/+-f �a+1<N@E<_[3<E+;AJH12\+3np@�AP[3),R"+1>O>?A 7N6�[(+-<L+a@E6d:J6"<E` BDH1<EZ_7�+-<E6+;:a+-)?>?+1`3>?61M-`343@�)?% "+-%3%(+J'3+3n;BD<E6�c\436�%\@=>?A^+i7=)?%321>?6I:J6"<E`#7N@=6�Z )?7�6�Z/[3>OHaAJ6�'�W XG9P4(7"nH1%�@=936_7=43<=B�+1Rr6Jn�)}@^7=6"6�Z/7S@E9(+a@)O@'3H\687i%3H-@^'*),7�@E)O%(2143),7N9~`56"@�FI6�6"% �='3+1<E+;:a+J+:(N+1+�P9P43>?+J+ �i+-%(' �E'3+-<L+;:a+1+:(N+J+Q�P93H1>,+1+ �3W0qYHaFI6�:16�<�na)?%/[3<E+JRk@E)?R"6 HJ%36]R"+1%�'3)?7N@=)?%3214()?7=9`e6r@�F 6"6"%�@E936@�F H/4(7=+121687Q`PAb[(+;AP)?%32_+a@N@E6"%\@=)?H1%�@EH/@=936K216"%5'*6"<]Z_+1<=�P)?%32/H1%�@=9(6:16�<=`0M1)?%_@=936]T(<E7N@IR�+17=6Q)}@tFQ)?>?>(`e6Y%36�4*@=6�<t216�%('*6�<pFQ93)?>O6])?%/@=9(6Y7N68RrHJ%('�nJ@�A\[()?R�+->?>OAJn)O@iFQ)?>O> `e6�+b%3H1%*fl%36�4*@=6�<S2J6"%('*6�<�D��DFQ936�<=6 " 7N[e6�R")}T56�7 "+-%3%(+J'3+�7=6"%\@=6�%(Rr6Jn��iq7=[568Rr)OT(6�7QqY)O%('3)0[3<EH*'*4(Rr68'b`PAb+1%P4(7=+1<E+1�a+J�kW

� ~�|!{>{ � �7z�� �>}7��}7�!�A�7�� � ~ �;{,�;{ � {>{ �>{7{��>�>�!z>{>{ �?���!�>z7{>{ �

��� �;}��;�>�,� � � } � }-� ��� ~�|!{>{ � �7z�� �>}7��}-�;{ � �� � ~ �;{,�;{ � {>{ �>{7{��>�>�!z>{>{ �?���!�>z7{>{ �

� ��� } � � � } � }-���7�;}��;�>�,� �+ � � � � � � � �����;  � ����¢;� �L£r� � ×Q¥N� �1� � � �E� � � ��� �;� � �?� ¤�¤ �'& ¥ �¢ �C� ( �)� � ( �)� � � ���k� ×]� � £k¥ � �,�� �;�;� � ���k� &��k� � ! *E �0� ¥ � ¥ ��� �� ¥k× ( � �E� ���k� � � ( ��� ����� ¥ ���k� � ¥ � �Y�  k� ¥�¥p×Q¥ � �Y� ���N�k�.�;���;  � � � � � �1� � �.� � ���-�;� k� ��×>×]� � # &0� ¥ � ¥ � ¥ ��� � ��� ( �)�.� ��¢ ¤�¥ &0� � �8�)� �1× �8�l� ¥ �J�k� ��� �1�^�;� � ¢1� � � ¥ � � ¢-�)� �p�  k� ¥N¥k×Q¥ � �

&0� ¥ ��� � ���p�;� � ( �)�.� ��¢ ¤�¥ � � �;� � � ¥=� ��� ¤ �� ¢1� � � �;� � � ( � ¤ ��� � &0� ¤�¤ ¢ ¥ ( � ��¥ � � � �L¤�¤ � ���k�8� �-� ���; � � � � ¥ �1� ¥ � * �a� � × � � ¥ � � � ¤ � � � ( �k��� � �L� ��� ¥ & # � ���L¤ & �'� ��� ¥�¤ ( � � � £k¥�¥ ( � � ¥ &��k� £ ���8 S�L� � � ¥� � � ��¥k× � � × ( ¤�¥0� �1� � � ( ��� ����� ¥�� � � � � �8� � ¤ ( ��� � �8� ¥ �L� � � ¥ &��k� £ ���; t�L� � � ¥ � � � � ¥k× � � � � ¥ �1� ¥ � *F� � � � � � �k� ���k�S£ �;� ¤ �k��� � � ( ¥ � ¥ � � � ¥ �;���k�'* ! ��� � ����;��� × ( ¤�¥&� ¥ � ¥ � � ¥ �;� ¥ �������� ¤ �E� ���k�¢1� �� � � � �Y����� �;����� �;��� ���)�;�.� ¥ ���]� ¥ � ( �k�1� ¥ � � � � ¥ �� ¥ � � ���k� � �k��×]� � ¥ £��"�k� £ � �"�k����� � G�� �E� �;���� ��× �;� � !

Page 125: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,� �%*!����� ������ �� �� ��%'� !P��� �K� � ���=� � �� v1v7y.�H\7=7iH1B +-2J<=6�6"Z/6"%\@C)?7C%(H-@6rV*[e6�Rk@E6�'�@=H�`e6/@=HPH"(N+-<E<=)?%32�@=HUq])?%('*)t7=[e6�+-�J6"<L7)?%y:\)?6"F H1Bi@E936")?<�6"VP[eHJ7=43<E6�@=H�:a+1<=)?H14(7�:;+1<=)?6r@E)O687_H-B%3HJ%*fl%(+a@E)O:J6�qY)O%5'*)S9(6�+-<L'6":J6"<EA*'3+;A_+17G[3<EH1[(+12J+-@=6�'b`PA_@=6�>O6�:\),7=)OHJ%�n3<L+1'*)?H�+1%('�T(>?Z/7�W

<>= <�� �'G����JG � � � BED����� R� [5+-<=@QBD<=HJZ +-2J<=6�6"Z/6"%\@G@=9(6"<E6^+-<E6iHJ%3>?A�@=9(<=6�6Z/+�(�H1<]7=AP%J@L+1Rr@=),Ri'3)}��6"<E6"%(R"6�7Q`e6rf@�F 6"6"%sq])?%('*)I+-%(' "+-%3%5+1'3+(W/�P4(<=[3<E),7N)?%321>?A�+->?>�H-B @=9(6�7=6/R�+-%h`56/@L+-�J6"%sR"+-<E6�H-B`PAb6�%3<=),RL93)?%32�q])?%('*)mFQ)}@E9�+�BD6"F +1'('*)}@E)OHJ%(+->�BD43%(Rk@E)OHJ%(+->m[(+-<=@=),Rr>?6�7]H1<Y7=4*�/V*6�7]+J77=93HaFQ%~`e6">?HaFW_XG9P4(7"n0@=936�A~R�+-%h`56_:P)?6"F 6�'h+17C>?6rV*)?R�+->�2\+-[(7iH1<CBD4(%(Rk@E)OHJ%hF H1<L'2J+1[(7�W >,+-%(214(+1216i`3<=),'*2J6�7��� ��� � ������ ��� � �� �

$&%�R"+J7N6H1B�6"ZK`e6�'('*6�'U7=6"%\@=6�%(Rr687Q)?%�q])?%('*) n(@E936�7=6K+-<E6C[34*@C+aB @=6�<Q@=9(6^Z_+-)?%U:16"<E`43%3>?)?�16^)?%!"+-%3%(+J'3+3W {3HJ<]6rV3+-Z/[3>?6��DFQ9(6"<E6�"/n(q^ne+-%('Uoy7=[e6�Rr)OBDA�@=936^>,+-%(214(+1216H-Be@=9(6]7N6�%J@E6"%(R"6Q+17�"+-%(%(+1'3+(n-q])?%('*)(+1%('/op%32J>O),7=9�n-<E6�7=[568Rk@=)?:16�>OA�M�) � q +17N@E+1%('37�BDHJ<21>?HJ7E7 )O%�q])?%('*) n ) � o+PBDH1<Q2J>OH\7=7I)O%Uot%321>?)?7=9�n �iq BDH1<]+1%\457=+1<E+1�;+^H14*@E[34*@])?%dqY)O%('3)�n6r@LR-W��ku� � � � � ~&�;{>{P��{ � } ��{��;{>{ � � �����!{ � { ��{>z>{ {>{���} � {>{

� � ~ !{P��{ � {���� �7�!{,� �����!{ � { �;�P�����>�;��n�7�2� } �,� �>�� ~ � !{P��{ � {�����7�;{,� �����;{ � {����7z7z �7�P� } �;�P���,�7�;����

�E~ � �;{>{P��{ ��} � ��;{ � � } � }$�1�;{,��} � {>{ � � � { � } � } �!� � �>�>��} � } � � ~��;{>{P� �!{��!{>{ � � � };��� � �!{,�;{ �!� �>{>{��7� � � {>{

� !{P� � {��� �7�!{����;}�!�7z>z � � �!�P� } �

�]H1@=6Jn3@=95+a@Q@=9(6K+-`eHa:16 "+-%(%(+1'3+/7=6"%\@=6�%(Rr6^7=H14(%('37QH*'3'd@EH�+ "+-%3%(+J'3+�[56�<E7=H1%0n`e6�R"+14(7=6SH1B0@=9(6iHJ<E'36"<GH-B�@E936^RrHJ%(7N@=)O@=436�%J@L7"W�qYHaFI6�:16"< `PA_4(7=)O%32 �=6"),7=+J+ �)?%(7N@=6�+J'H-B �N�P)�KF 6R"+1%d68+17=)O>?A�+;:1HJ)?'�@=93),7Q[3<EH1`(>O6�Zdn3+J7G)O>?>?4(7�@E<E+-@=68'�`e6">?HaFu� � � � �E~ �����!{ � { � {>{ � } |!{��7� � { � � }$�"�7� ��{>{P��{ ��} � ��;{ � �

� � ~ �����!{ � { ��{>z>{ {>{���} � {>{ };� � {7{��;{>{P��{ � } ��{��;{>{ � � ~��!���!{ � { �;�P�����>�;��n�7�2� } �,� �>� �7�!{,� ;{P��{ � {���

) 6"),7=+J+,+�RrHJ%(7N@=<E4(Rk@E)OHJ%~),7^+�[3<EH1[e6"<^R"H1%(7N@=<E4(Rk@E)OHJ%~)?%�q])?%('*) M�H1%3>?A�)O@K),7C4(7=6�'s>?6�7E7BD<E6�c\436"%\@E>OAJWd$&%s@E936�'3)?+1>O68Rk@KH1BQqY)O%5'*)t[3<EH*'*4(R"6�'s`PAh+1%P4(7=+1<E+1�a+3n�93HaF 6":J6"<8n�@E93)?7FQ)?>O>�`e6C@=9(6%3H1<EZ_+->�RrHJ%(7�@E<=45Rk@=)?H1%d4(7=6�'�W�� � � ������ ��� � �� �

"+-%(%(+1'3+h9(+J7�+s>,+-<E216�%P43ZK`e6"<�H1B^+1' (�68Rk@=)?:a+->][5+-<=@=),Rr)?[3)?+1>][393<L+17=6�7/HJ<bRr>,+-457N687FQ93),RL9�RrHJ%\:J6"A�)?%*BDHJ<=Z_+a@E)OHJ%h+1`5HJ4*@^@E6"%(7=61n�+17=[568Rk@K6"@ER1Wb`34*@#@=936�A~'*H�%3H-@^9(+;:J6)?%*BDH1<EZ_+a@=)?H1%�+-`eH143@]�;+1<E+1�a+#<E6">,+a@E)OHJ%(7�W�$&%�7=6"%\@E6"%(R"6�7� �*W y �G+-%('s�$�PW ©\�kn "+-%3%(+J'3+RrH*'*687G)O%3BDH1<EZ/+-@=)?H1%�+-`eH14*@Q@E6"%(7=6C)O%�68+a@=)?%32_+-%5'�Z_+1�\)?%325W

Page 126: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v1v © ���������� � � � � ���$&%��� ��% ��� ��P$]��%

� � B%� �E~ �;{>{P��{ �!���"�;{��7{P��{��,{ � { �>� � ��� � } � � ~ �;{>{P� �>�!{>{,�;{7{ �7�!{>{ �,{P�>��{��,{��7�!� �;{>{>z>�

� � �� � �E~ �;{>{P��{ �;{,�;{>{��!� � ���{ �,{P��{��7{ � { �>� � ��� � } � � ~ �;{>{P��{ |!{ � {>{��;{>{��7�!{7{ �7{P�>� {��7{��7�!� �!{>{>z>�

$l@�'*HP687_%3H-@dRrH1%\@L+-)?%w)?%*BDHJ<=Z_+a@E)OHJ%y+-`eH14*@_@E936�<E6">,+a@=)?H1% 68+a@b9(+J7/@=H�7=[eH\HJ%H1<Z_+1�16/9(+17i@EHU7N[eHPH1%�W_$l@^),7i@=936b`(+1RL�P21<EH14(%('U�P%3HaFQ>?6�'*2J6#@E9(+a@[3<EHa:P)?'36�7i@=9(6<E6">,+a@=)?H1%w`e6r@�F 6"6"% @E936"Z�W {3HJ<�6rV3+-Z/[3>?61nI@=9(6�216�%36"<L+->QF H1<E>?'w�P%3HaFQ>?6�'*2J6�Z/+;A`e6b4(7=6�'h@EH~7E+;A�@=95+a@�7=[eH\HJ% )?7^@=936�)O%57�@E<=43Z/6�%J@#H-B]6�+-@���+1%(' ),7^%3H1@K6�+-@=6�%5�)?%� �*W y �kWC$&%�@E936�%36rVP@7N6�%J@E6"%(R"6��$�PW ©\�S7N[eHPH1%�R"H143>,'�`e6K@E936�)O%(7N@=<E43Z/6"%\@CH1<S@=936�Z/6H-B�Z_+-�J61W �q])?%('*) n1HJ%K@E936GH-@E936"<�9(+1%('�n-95+17�H1%(>OA@�F Hi[(+-<=@=),Rr)?[3),+->*[393<L+17=6�7 :P)��1W AJ+1+ 9P4(+J++-%5'�@L+1+ 9P4(+J+KFQ9()?RL9URrH*'*6C[e6"<=BD6�Rr@=)?:16^+-%5'�R"H1%\@=)?%P43H14(7Q+J7N[e6�Rr@E7GHJ%3>OAJn*61W 2(W?n� � �� � � ~����!{>{,��{>{ �>�!{>{ � �!{>z>{

}�{,��} � � �7�����

� � � � � ~����!{>{,��{>{ �>�!{>{�z>{��!{A�!{>{}�{,�!� �>� |!�,�

XG9P4(7�n\+1%\457=+1<E+1�;+CF H14(>?'_`e6C+-`3>?6Y@EHK4(7=6]@E936�7=6CRrH1%57�@E<=4(Rr@=)?H1%(7t)O%dq])?%('*)�H1%(>OAFQ936�%s@=936b@=6"%57N6�)?%*BDHJ<=Z_+a@E)OHJ% )O% "+1%3%(+J'3+�)?7#+-[3[(<=HJ[3<=),+a@E61W9W 4*@#FQ9(+-@#+-`eH143@@=9(6H-@=9(6"<G@=6�%(7=61n(+J7N[e6�Rr@Q+1%('dZ/HP'(+->?)}@�A ��XG936�<=6C),7]+/7NAP%\@E+JRk@=),Ri93H1>?6C)O%UqY)O%('3) �?WXG936�<=6p),7 +-%3H1@=936�<0[3<EH1`3>?6"Z�na93HaF 6":J6"<8W�XG936p@�F HY[5+-<=@=),Rr)?[3)?+1>1[39(<E+J7N687�)?%Kq])?%('*)9(+;:J6�R"H*'*)O%(2~BDHJ<_�a+-<L+-�a+h<=6�>?+-@=)?H1%(7�FQ93),RL9 )?7_+1`(7N6�%\@�)O% "+-%(%(+1'3+(W AJ+1+ 9P4(+J+RrH*'*6870�a+1<=Z_+ � naFQ93)O>?6I@E+1+ 9\45+1+YR"H*'*6�7m�a+-<=@E+3Wm��+-<=@=),Rr)?[3)?+1>1[39(<E+J7N6i� �PW � �07=+;A*7�@=9(+-@BD<E43)}@ @=95+a@QF +J7p68+a@=6�%�nPFQ93)?>O6_� �*W � �p7E+;A*7p@E936S`eHaA/FQ93H�)?7 6�+-@=)?%32(W�XG9P4(7�n*q])?%('*)�)?7[eH\HJ<=6�< @=9(+1% "+1%3%(+J'3+K)?%URrH*'*)?%32�@=6�%(7N6Jn(+17=[e6�Rk@8n3Z/H*'3+->?)}@�Ab)O%*BDHJ<=Z_+-@=)?H1%�n*FQ93)?>?6<E)?RL936�<^)?%�RrH*'*)?%32��a+-<L+-�a+�)?%*BDH1<EZ_+a@=)?H1% )?%�R"+J7N6_H1BY+1' (�68Rk@E)O:a+->I[(+-<=@=),Rr)?[3>?6�7�W7WI43@@=9()?7#RrH1Z/[eH143%5'37C@=9(6�[3<EH1`3>?6"Z BDH1<K+1%\457=+1<E+1�;+(W �Y7=)O%(2�@=93687N6�R"H1%(7N@=<E4(Rk@E)OHJ%(7)?%q])?%('*)eF H143>,'_Z/6�+1%_[34*@N@E)O%(2#)?%b7=H1Z/6r@E93)O%(2@=9(+-@I),7p%3H1@ R"H1%\@E+1)O%368'/)O%�@=936i7NHJ43<ER"6>,+-%32J4(+-2J6i7=6"%\@=6�%(Rr6JWXG936t+1%(7=FI6�<�>O)?6�70)O%K)?'*6�%\@=)OBDA\)?%32i+-%3H1@=936�<0RrHJ%(7�@E<=45Rk@=)?H1%)?%KqY)O%('3)\+1%('Rr<E6�+-@=)?%32+bR"H1<E<=687N[eH1%5'*6"%(R"6`56"@�FI6�6"%�)O@i+1%('�@E936�R"H1%(7N@=<E4(Rr@=)?H1%(7Q4(%('*6"<CRrHJ%(7=)?'*6�<E+-@=)?H1%U)?%"+-%(%(+1'3+(Wq])?%('*)e9(+J7I+1%3H-@E936"<tR"H1%(7N@=<E4(Rr@=)?H1%*f @=936') (�H +\R"H1%(7N@=<E4(Rr@=)?H1%*flFQ93),RL9/+1>O>?HaF]7�`eH-@E9@=6�%(7=6b+-%('s�a+1<E+1�;+�)?%*BDHJ<=Z_+a@E)OHJ%s@=H�`e6b7=[568Rr)OT(6�'�W�{3HJ<^6rV3+-Z/[3>?61n @EH�7=+;A�) FG+17=9@=9(6^7N[eHPH1%dFQ)}@E9dFQ9()?RL97U]+1Z 9(+17G68+a@E6"% +3F 6R"+1%�FQ<E)}@E6^+-%PA�H1B0@=9(6CBDH1>?>OHaFQ)?%32(u� � � { � �;{7{P��{ � } ��� � {��7{P�>��{>�7{ � } ���;{>{,�;{>{��,�!{>{ � � {A�����7�;� �!{>{>z7� �)�C�)� � � �E� � � ¥ � ( ¥N�L£k¥ � � � � ¥ �.�;� ( ����� ¥ � � � ¤�¥N� � �^�L� � �;����� � � � *t��� ¥ ���8�O�k� ×]�E� ���k� � � � ��× ������ ¥ & #a� � ¥ � ¥ �O�k� ¥)# � � ��� ¥ � �� ¥ � � ���k�1� � ¥ � � �;� � ¥ � ¥ � � � � � � � �;�)� ¥ � � ��� ¥ � � �1� � � �1�;� ¥ �C���i�N�k� � ¥ � ¦� ���k� �L¤P¤ ���; )�;��� � ��� �'*� �C�k� ¥ ���k� � ¥ � ��¤ ��#1�"�k� ��� �k� ���� ¥ � £E� � ×]� ���i� � � ¥ �L� � �L£E� � ×]�L£E� �k� � � � �1� � � � � ¥ � ¥ ��¢1� #;� �1�£L� � �l� ���i� � � ¥ �L�3��� � � � �1� � � � � ¥ � ¥ � ¢1�'*

Page 127: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �����n��! � � � �� v1v ��;{7{P��{�}7� � �>���7�A� �A� �>� � � ��� �7� �}�{,��} � �7�;{,���!{ � ���� { � � �7��} �A� �>� � �����7� �7���>�A�� ;{P� �!{ � }�{,��} � �

� � � | � �;{7{P��{ � } ���!{>{,��{>{��7�!{>{ ��� � { �,{P�>��{��,{ � } � � }��7�!� �;{>{>z>� � � � � � �;{7{P��{ � } ���!{>{,��{>{��7�!{>{ ��� � { � } � � { �,{P�>��{��,{ �����7�!� �!{>{>z>� XmH~6"VP[(<=687=7K@=936U7E+-Z/6b)?%*BDHJ<=Z_+a@E)OHJ%�+J7#)?%�@E936!"+-%3%5+1'3+~7N6�%J@E6"%(R"6�7d� �*W y �K+1%('� �*W ©P�kn*F 6^R"+1%�)?%P:16"%\@]+�%3H-@L+a@E)OHJ%d+1>OHJ%32/FQ)}@E9�@E936�(�H-f&RrHJ%(7N@=<E4(Rk@E)OHJ%�+17 BDHJ>O>?HaF]7�u� � ���� � ��{>{P��{ � } ���!{>{��;{>{��7�!{7{ �>�>� � � {��!{ �,{P�>��{��,{ �����7�!� �!{>{>z>� XG936Q:P)?`39(+-�\@E)*Z/+1<=�J6"<L7I��)�W 61W?n-@E936GBD43%(Rr@=)?H1%(+1>3F H1<L'37�7N6Jn-�1HC6r@LR-W��^+1<=6G<E6"[3>,+1R"6�'^`PA)�� +?W ) (�H ��+*RrH14(>?'b6":16�%b`e6C<=6�[3>?+JRr68'�`PA9) (�HJ43%(+E+J@EH#[(<=H*'*4(R"6i+#�P)O%5'bH1BmRrHJ>O>?H*cJ4()?+1>q])?%('*)0)O%U7=H1Z/6C<=6�21)?H1%�W� � ����$� ��{>{P��{ � } ���!{>{��;{>{ �7�;{>{ �>��� � { � {��!{��7{P�>��{>�7{ ����,�!� �!{>{7z>� �]%(>O)?�16d@=9(6�T(<E7N@�R"+J7N6Jnp@=9()?7/),'*6�+~@L+-�1687_7NHJZ/6b@E)OZ/6�+-%5' 6"�eHJ<N@/BDH1</@E936Uq])?%('*)<E6�+1'36"< @=H_2J6r@Q4(7=6�'�@=H5W� ��� � � ������ ��� � �� �

XG93),7 �=%36 �_R"H1%(7N@=<E4(Rk@E)OHJ%�),7Y+/[e6�R"43>?)?+1<=)O@�A�H1B HJ%3>?Ab@E936^gh6�7N@=6"<E%U`e6">O@Y>?+1%32145+-21687)?%�$&%('*),+3WQ$&%�R�+17=6^H-B�@E936K[3<E6�7=6"%\@YHJ<Y[(+J7�@S[56�<NBD68Rk@=)?:16�+17=[568Rk@YH1B�@=936#Z/+1)O%�:16"<E`)?%�qY)O%5'*)07=6"%\@=6�%(Rr6Jn �=%36 ��),7G4(7N68'dFQ)}@E9�@E936�a+-<=@E+(u� � ��%� � ~&�;{>{P��{ � } � �!{7z>{ ���!{7{,�;{>{

!{P� },� � � �7�!��� {,��} � !{P�s{���}��7�;} � �7����� ��

$&%UR"+J7N6CH-B AJ+J+ 2J+;AJ+J+KX � X >,+-`e6"> n ) %(6[+3),7G%3H-@]457N68'�W� � ���� � � ~��;{>{P��{ � �!{>z7{ ���!{>{ � {,�;{>{ XG936�<=6"BDH1<E61n-F 6YR"+1%_[5H\7�@E43>,+a@=6i+%36�FwF H1<L'/X � X �NA\+1+,) �iFQ)O@=9b7E+-Z/6Y7=6"Z_+-%3f@=),R"7 +17 �NAJ+J+ �(n-`34*@ FQ93)?RL9�'*HP6�7p%(H-@I457N6 �=%36 �KRrH1%57�@E<=4(Rr@=)?H1%�M\FQ)O@=9_@E93)?7IX � X F 6R"+1%�6"V*[3<=687=7 @E936^RrHJ<=<E6�7=[eH1%('*)?%32 "+-%3%(+J'3+�7N6�%J@E6"%(R"6Z/H1<E6YB�+1)}@E9*BD43>?>OA�+17�u

�;{>{2��{ � �!{7z>{ ���!{>{��;{>{ �

�/ �� ���!� � �� �gh6�9(+;:J6�+-<E214368' @E9(+a@�)}@d)?7b[5H\7=7=)O`(>O6U@EH�Ha:16�<ER"H1Z/6d@=936~>?+1%32145+-216�`(+1<=<E)?6"<�)?%$&%('*),+U4(7=)?%32�+-%P4(7E+-<L+-�a+3W � %P4(7E+-<L+-�a+d@=<E)O687C@=H�@E+-�J6�+1'*:a+1%J@L+-2J6�H1BG@=936�<E6">,+a@E)O:J67N@=<E6"%321@=9(7 H-B5@=936]R"H1Z/[34*@E6"<�+-%5'^@E936G9\4(Z/+1%#<E6�+J'*6"<8naFQ936�<=6I@=936QR"H1Z/[34*@E6"<�@E+1�1687@=9(6i>,+-%(214(+1216Y>?HJ+J'b+1%('b>?6�+;:J6�7t@=936CF H1<E>?'��\%(HaFQ>O68'*216i>OH\+1'bH1%�@E936C<=68+1'*6�<�W $l@Q)?7[(+1<N@E)?R"43>?+1<=>?AY6"�e68Rk@E)O:J6pFQ936"%^@=936I>?+1%3214(+121687�+-<E6pRr>?HJ7=61n;+170)?70@=936IR"+17=6pFQ)O@=9^$&%5'*)?+1%� � �M×]�'� ¢ ¥ �L�*��� � ¥ � ¥ � ��� � �;� � ¥�� � �E��� � ¥ �"�k��� ( � �E� �"�'�"� ��� � ���-�;�J���k��� ¥ � ( �k�1�1� � � £r�l���

( � �E� �"�'�"� ��� � � �;���;� ¡ �0 k� ��×>×]� � � �1� � � � � ¥ � ¥ & ( � � ( �)� ¥ � ( � �E� �"�'�"� �"�k��� &0� ¤�¤ ¢ ¥ � �E� �;� �L¤���)�;� � ¥ � ( � � � �L� � � ¥ £r�l� � �E� � � ( � �E� �"� �"� ��� � � ¥ �8� �1� £ ��� �  k� ��×>×]� � *

Page 128: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v1v � ���������� � � � � ���$&%��� ��% ��� ��P$]��%

>,+-%32J4(+-2J6�7�W "C6"6"[()O%32Y)O%^>?)?%36tFQ)O@=9@E936I+1%P4(7=+1<E+1�a+I[(93)O>?HJ7=H1[(9\AJn�)O@m`(<=),'*21687�@E936t2\+-[`e6r@�F 6"6"%/>,+-%32J4(+-2J6�7�`PA#RL9(HJ7=)O%32i@E936QZ/HJ7N@I+-[3[(<=HJ[3<=),+a@E6IHJ<p%368+-<E6�7N@�R"H1%(7N@=<E4(Rr@=)?H1%+;:a+-)?>?+1`3>?6])O%b@=936S@E+1<=2J6r@ >?+1%3214(+1216Q@EH12J6r@=9(6"< FQ)}@E9�7=43)}@L+-`3>?6S+J'3'*)O@=)?H1%(+1>�%3H-@L+a@=)?H1%0W$l@�%36�6�'37�@=H `56�<E6rf&7N@E+a@E6�'�@E9(+a@�6�:16�% FQ)}@E93H14*@s+ 7=6"%\@=6�%J@E)?+1>K[(+1<E7=6"<8nC@=9(6+-%P4(7E+-<L+-�a+bBDH1<^$&%5'*)?+1% >?+1%32145+-21687'*6">?)?:16"<L77=H1Z/6r@E93)O%(2�[3<L+1Rk@E)?R�+->�@EHP'(+;A1W9XUH1<E6'*6"@E+-)?>?6�'w7N6�%J@E6"%\@=),+->QHJ</@=6"V\@�+1%(+->?A*7N),7�<=68cJ4()O<E6�7�[3<E6"[(+1<E+-@=)?H1%�H-BS�a+1<E+1�;+hRL9(+1<N@L7+-%5'#H1@=936�<p>?6rV*)?R�+->('(+a@E+1`(+17=6�7�WmXG9(6�7=6YR"+1%�`e6]2J<E+J'*4(+->?>?A^`343)?>}@ +-%('/)?%(RrHJ<=[eH1<L+a@E6�')?%�@E936^7=AP7N@=6�Z�W�XG9P4(7�n*@E936^7NA*7N@=6�Z )?7Y'*6�7=)O2J%36�'b@=H/2J<=HaF Z/H*'*43>,+-<E>?A1W� %P4(7E+-<L+-�a+#R"+-%�`e6:P)O6�FI68'�BD<EH1Z @E936CBDH1>?>?HaFQ)O%32_'*)O��6"<E6"%\@Q[5HJ)O%\@E7]H-Bm:P)?6"FWv W � %P4(7E+-<L+-�a+#+J7Q+-%d6":JH1>?4*@=)?H1%(+1<=A�7=A*7�@E6"Z�W � %\457=+1<E+1�;+�'*6�>O)?:16�<E7Q7=H1Z/6r@E93)?%32[3<E+JRk@E)?R�+->-@EH*'3+;ACFQ)}@E93H14*@ F +1)}@E)O%(2]BDH1<�7=6":16�<E+1>1AJ6�+-<L7�+1%('^9(+J7�@E936I[eH-@E6"%\@=),+->@=Hd�16"6�[�[(+JRr6#FQ)}@E9h'*6�:16�>OHJ[3Z/6"%\@E7i)?%�@=68RL93%3HJ>OHJ21A�M�@=936/F H1<E�b@EH�`56/'*H1%(6BDH1</`343)?>?'3)O%32s)O@�n %36"68'37�@=Hs`e6�'*H1%(6�)?%y+-%PA�R"+J7N6�BDH1<_93)?2193flc\4(+1>O)O@�AsBD43>?>OA+-4*@EH1Z_+a@E)?RCZ_+1RL9()O%36^@=<L+-%(7=>?+-@=)?H1%U7=AP7N@=6�Z_7"Me+-%('�)O@E7i+;:a+-)?>?+1`3)O>?)O@�A�FQ)O>?> 936">?[)O%d+1R"R"6">?6"<L+a@E)O%32^@=936CF H1<E�#@EHaF +1<E'(7t'*6�:16">?H1[(Z�6�%\@IH-B Z_+1RL93)?%36]@E<E+1%(7=>?+-@=)?H1%7NA*7N@=6"Z_7GH1B0@=9(6CBD4*@=43<E61Wz W � [3<L+1Rk@E)?R�+->t+1[3[3<EHJ+JRL9�@EH�'*6":J6">?H1[s)?%J@E6"<EZ/6�'*),+a@E6�>?+1%32145+-216U��H1<^)?%\@=6"<E>?)O%*f214(+\�SBDH1<#+�2J<=HJ43[sH-BQ>,+-%32J4(+-2J6�7�W ZS6�7=)O2J%36"<L7^R"+1% 216"@#+dT(<L7�@K95+-%('s:P)?6"FH-BI:a+1<=)?H14(7C7=H143<LRr6�>,+-%32J4(+-2J6#[39(6"%3HJZ�6�%(+d)O%h@E6"<EZ/7CH1Bt@E936_>?+1%32145+-216#@=9(6'*6�7=)O2J%36"<G�P%3HaF]7�Wy W � Z�H*'*4(>?+1<Y7NA*7N@=6�ZdW WIAd+1'3'3)O%32�7=43)O@E+1`3>O6Z/H*'*43>?6�7�n3)O@SR"+1%�`56KR"H1%P:16�<N@E6�')O%\@=H5u

�� '*6�:\),Rr6C@EH/43%('*6�<E7N@E+1%('�7=H14(<ER"6i>,+-%(214(+1216S@=6rVP@8W

�q]4(Z/+1%U+-),'*6�'�Z_+1RL93)?%36C@=<L+-%57N>,+a@E)OHJ%�7=AP7N@=6�Z�W

�{34(>O>?A~+14*@=HJZ/+-@=68'�93)?219sc\4(+->?)O@�A�'*H1Z_+1)O%s7N[e6�R")}TeR/Z/+JRL93)?%36�@=<L+-%(7=>?+-f@=)?H1%U7=A*7�@E6"Z�W

©5W � F +;AQ@EHQB�+1Rr@=HJ<=)��"6�>,+-%32J4(+-2J6 [5+-<=@�BD<=HJZ F H1<E>?'S�P%3HaFQ>O68'*216�[(+1<N@8W � %P4(7E+-<L+-�a+7N432J21687�@L7 +/R">O68+-%�F +;A/@EH�7N6�[(+-<L+a@E6Y@E936>,+-%32J4(+-2J6S�P%3HaFQ>?6�'*2J6iBD<=HJZ FIHJ<=>,'�\%(HaFQ>O68'*216JnI+-%5'�9(HaF @=H 457N6d@=9(6"Z )O%yRrHJ%(7N@=<E4(Rk@E)OHJ%�H1BC+ 7=A*7�@E6"Z )?%y+7NA*7N@=6"Z_+-@=),RSFG+;A1WXG936�<=6i+-<E6S7=H1Z/6iR"H1Z/Z/H1%�Z/),7=R"H1%(R"6"[*@E)OHJ%(7G+-`eH14*@Q+-%P4(7E+-<L+-�a+(W0gh6i'*687=R"<=)?`e6@=9(6"Zj%(HaFWv W � %P4(7E+-<L+-�a+K),7]+ �N<EH14(219 �K@=<L+-%(7=>,+a@=)?H1%�7=AP7N@=6�Z�ut�\@=<E)?Rr@=>?Ad7=[e6�+-�P)?%32(nP@E93),7Q)?7%3H-@�@=<E4361W �IHJ%(Rr6�[*@=45+->?>OAJnt+-%P4(7E+-<L+-�a+U),7/'*)}��6"<E6"%\@�BD<=HJZ @=<L+-%(7=>,+a@=)?H1%0W $l@[3<=Ha:P),'*6�7Y6rV3+1Rr@=>?Ad@=936�)O%3BDH1<EZ/+-@=)?H1%hRrH1%\@L+-)?%36�'U)?%�@E936/7NHJ43<ER"6^@E6rVP@�n�FQ93)?>?6@=<L+-%(7=>?+-@=)?H1%U)?%P:1H1>?:1687Y)?%\@=6�<=[3<E6r@L+a@E)OHJ%�H-Bp@E936/7NHJ43<ER"6^@E6rVP@`56"BDH1<E6#6"VP[(<=687=7Nf)O%32d)O@^)O%~@=936�@L+-<E216r@C>,+-%32J4(+-2J61WK$&%sR"+J7N6�H-B >O6�2J+1>�'3HPR"43Z/6"%\@E7�n�@E936"<E6rBDHJ<=6Jn@=<L+-%(7=>?+-@=)?H1% 7=6">,'*H1Z 7N43�_R"6�7�W � %P4(7E+-<L+-�a+�HJ%s@=936�H-@=9(6"<K95+-%(' FQ)?>?>tH1%(>OA

Page 129: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �����n��! � � � �� v1v �7=+;A FQ9(+-@_)?7/6"VP[(>O),Rr)O@=>?A 7N@E+a@E6�'�Wwgy936�%wHJ%36�)?7/FQ)?>?>O)?%32h@=Hs[34*@�)?%w6rVP@=<L+6r��H1<=@#+-%('h@E)OZ/6b@=936�% H1%3>?)O%(6�H14*@E[34*@�H-BY+-%P4(7E+-<L+-�a+dR"+1% `56d7N43[e6"<E)?H1<@EH+-%PA�@E<E+1%(7N>,+a@E)OHJ%�W9WI68R"+14(7N6�+1%P4(7=+1<E+1�a+bZ_+-�J6�7CBD4(>O>G7N4(<NB�+JRr6_)?%*BDH1<EZ_+a@=)?H1%0n+17pF 6">?>5+J7tR"H1Z/[3>?6r@=6Y>?+1%3214(+1216Q�P%3HaFQ>?6�'*2J6Y+;:a+-)?>?+1`3>?6G@=H^@E936Y<E6�+J'*6"<8n1)OB�@=9(6<=68+1'*6�<i),7FQ)?>O>?)?%32U@=H�@L+-�J6/7=H1Z/6_[(+1)O%57"nm936�R"+1%h2J6r@BD43>?>I+1[3[3<E6�R")?+-@=)?H1%hH-B@=936]HJ<=)?21)?%(+1>*@=6"V\@8W�XG936]6r��H1<=@tHJ%/@=936S[(+-<=@tH-B�+<E6�+J'*6"<IR"+-%_`e6]Z/)?%3)OZ/)��"68'`\A�u��+J��@=9(6[3<=HJ[56�<]'*6�7=)?21%dH-B @=936)?%\@=6">?>?)O2J6"%\@Q4(7N6�<Q)O%\@E6"<=B�+1Rr6JM�D`5��[3<EH1[e6"<G@E<E+1)O%3)?%32/H1%�@=9(6[(+-<=@QH-B�<=68+1'*6�<�M��R���[3<L+1Rr@=),Rr6C)O%�4(7=)?%32�@=936^7=A*7�@E6"Z�W

z W � '�93H*RQ)?Z�[(<=Ha:J6"Z/6"%\@E7�7=4(RL9_+17�[5+-<=@=),+->(+121<E6"6"Z/6�%J@pR�+-%/)OZ/[3<EHa:16 @E936Q[56�<NfBDH1<EZ/+1%(Rr6_H1BG@=936d7NA*7N@=6"Z�u/XG93),7^),7^%3H1@#RrHJ<=<E6�Rr@�n `568R"+-457N6/@E936"% @E936b457N6�<FQ)O>?>m%(H-@C`56/7N4(<=6�+-`eH14*@CFQ9(+a@i@=H�6rV*[e6�Rk@+-%5'�FQ9(+-@S%3H1@S@EHb6rV*[e6�Rr@SBD<EH1Z@=936�Z_+JRL93)O%(61W $l@b[(+;A*7/@EH��16�6"[w@=936~FIHJ<=�P)?%32sH-BC@=9(6�Z_+1RL93)?%36�7=)OZ/[3>?61W�PAP%J@L+1Rr@=),RY7=432J+1<I),7I@=H�`56C+1'3'36�'b+-@ [e6"<L7=H1%(+1>5<E)?7=��Wm$l@QZ_+;A_7NHJZ/6r@=)?Z/6�7 `e6)O%:(�4(<=)?H14(7@=H�9368+->O@=9�W � 's9(HPR�)OZ/[3<EHa:16�Z�6�%\@E7CFQ93),RL9 FIHJ<=��BDH1<^HJ%36_@=6"VP@Z�)?219\@]R"+14(7=6i2J<E+;:J6Y[3<EH1`(>O6�Z/7GFQ)O@=9�H1@=936�<G@=6rVP@L7"Wy W � %P4(7E+-<L+-�a+3nr)?%[3<E)O%5Rr)?[3>O6Jn�),7�+12J+-)?%(7N@�9(+;:P)O%32]+Q7=6"%\@E6"%\@=),+->-[5+-<L7N6�<�u � %P4(7E+-<L+-�a+)?7t%3H-@G+-2J+1)O%57�@I7=6"%\@E6"%\@=),+->5[(+-<L7N6�<E7�W � 7=6"%\@=6�%J@E)?+1>([(+1<E7=6"<tZ/+;A�`e6S)?%(Rr>?4('*68''*6"[e6"%('3)O%32bH1%d@=936#+;:;+1)O>,+-`()O>?)}@�A�H-B�@=68RL93%3HJ>OHJ21Ab+1%('�>O)?%32J43)?7N@=),R'3+-@E+-`5+17=6�7�W� 7 @=9(6Q$&%('*),+-%�>?+1%3214(+121687 +1<=6GRr>?HJ7=61n1:\)?`39(+1�\@=)*Z_+-[3[()O%32C),7�c\43)}@E6Q6r��6�Rr@=)?:161WXG936"<E6rBDHJ<=6Jn\+1%\457=+1<E+1�;+iBDHJ<I$&%5'*)?+1%b>,+-%32J4(+-2J6�7IR"+-%b`56i`343)?>}@QFQ)O@=93HJ4*@GF +1)}@=f)O%32dBDHJ<C@=936/[(+1<E7=6"<i@=HU`e6_+;:a+-)?>?+1`3>O6JW�.m+a@E6"<8n�FQ936"%s>,+-<E216/RrHJZ�[(4*@E+-@=)?H1%(+1>>O6"VP),R"+1>p'3+a@L+-`(+J7N687C+-<E6�+;:a+-)?>,+-`3>?61n�[5+-<L7N6�<CR�+-%h`56b)O%(R"H1<E[5HJ<E+-@=68'�W#$&%hB�+JRk@�nBDH1<+-%h+-%P4(7E+-<L+-�a+/BD<EH1Z|op%(21>?)?7=9�@EH�$&%('3)?+1%�>,+-%32J4(+-2J6�7�n�+�[(+1<E7=6"<iFQ)O>?>�`e6+-`(7=H1>?4*@=6�>OA_%(6�Rr687=7E+-<EA1W

� JB�Q,N�� B H�� G��D��

�P68Rk@=)?H1%��PW v H1<E)O2J)O%5+->?>OA�+1[3[568+-<E6�'�)O%d@E936Z_+-2J+ �")?%36 z��[�(v �DBDH1<EZ/6"<E>OA��3Rr)?6"%(R"6XmHP'(+;A*�Q)O%U@E936 �\+-%P4(+1<=A v ª # ª/),7=7=4361W]{(H1<i+_@=43@=H1<E),+->0HJ% X�+1RL9()O%36#X0<L+-%(7=>,+a@=)?H1%0n7=6"6 "C)O%32 � v ª # �-�kW �Y)O<E6"%P`e6"<E2�� v ª # �-�bRrH1%\@L+-)?%(7�7=6":J6"<L+->C+-<=@=),Rr>?6�7�H1% FQ9(+a@�)?7[eHJ7E7N)?`3>?6Y+-%('�FQ9(+-@t),7p%3H1@�W�XG936�(�H14(<=%(+1>(H1B X�+JRL93)?%36YXm<E+1%(7N>,+a@E)OHJ%#),7p6"V3Rr>?4(7N)?:16�>OA'*6�:1H-@E6�'�@EHb@E93),7i+1<=68+3WC{3HJ<i+d'*),7=R"4(7=7=)?H1%�HJ%�+-%h+-[3[3<EH1[(<=),+a@E6K7�@E<E+-@=6�21AdBDH1< X�X)?%d$&%5'*)?+(n37N6�6 W 9(+-<L+a@E)e6"@Y+-> WQ� v ªJª-©\+J�kW�P68Rk@=)?H1% �PW z ),7d7E+-Z/6h+17 WI95+-<L+a@=)i6r@U+-> W � v ª1ª y R��rW {(H1<�+ '*),7=R"4(7E7N)?H1% HJ%+-%P4(7E+-<L+-�a+U+J7K+�Z/68+17=43<=)?%32U@EHPH1>G7N6�6 W 9(+-<L+a@E)t6"@/+1>�Ww� v ªJª y '(�kW � %P4(7E+-<L+-�a+�)?7'*),7=R"4(7E7N68'b)?%U'*6r@L+-)?>�)O%�@=9(6^�p9�W ZKW3@=93687N),7QH-B �Y+1<E+;A\+-%(+�� v ªJª-©P�kW�Y+-@=43<L+->�>,+-%32J4(+-2J6#)?%\@=6�<NB�+JRr6�@=HU'3+-@E+-`5+17=6�7i)?7+1%3H-@E936"<)?Z/[5HJ<N@L+-%\@^+-[3[(>O),R"+-f@=)?H1%�+1<=68+3WG�P4(RL9�+-%�)?%\@=6"<=B�+1R"6CBDH1<S$&%('*),+-%U>,+-%32J4(+-2J6�7 )?7S'*),7=R"4(7=7=6�'�)?% W 9(+-<E2J+;:a+� v ª1ª z �I+-%('9W 9(+-<L+a@E)�6r@Y+-> W]� v ª1ª y �kW

Page 130: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v1v # ���������� � � � � ���$&%��� ��% ��� ��P$]��%

Page 131: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� �

� ��� � � � � � � � � �S� � �

� � � � � � �

.�6"V*)?R�+->t{(43%(Rk@E)OHJ%(+->��i<E+1Z/Z/+1<���.m{���C),7K+U7N@=<EH1%32�R"H1Z/[34*@L+a@E)OHJ%(+->�BDHJ<=Z_+1>O),7NZ@=95+a@^+1'3'3<=687=7=6�7S93HaF @EH�6"V\@E<E+JRk@C21<L+-Z/Z_+a@E)?R�+-> <=6�>?+-@=)?H1%(7SBD<EH1Z|+d7N6�%J@E6"%(R"6/)O%h+[eHJ7=)}@E)OHJ%(+->�>,+-%32J4(+-2J6i7=4(RL9U+17Qot%321>?),7N9�W�$l@L7QZ_+:(�HJ<G7N@=<E6"%(2-@=9�),7G@=95+a@])O@]21)?:16�7G6"VPf[3>?)?R")}@t+1>O2JH1<E)}@E93Z_7"W0$l@E7�F 6�+1�\%(6�7E70),7 @=9(+-@p)}@p'*HP687�%3H-@�H-��6"<p+1%PAC@=936�H1<EA<=6�2J+-<L'*)?%32>?6rV*)?R�+->0+1ZK`3)?214()}@�AJn5+1':(�43%(Rk@L7"n5H1[*@E)OHJ%(+->0@=936"@E+-f <EH1>?6�7�n(+-%5'�Z_+1[3[3)?%32_BD<EH1Z�21<L+-Z�fZ_+a@E)?R�+->*<E6">,+a@=)?H1%570@EHi@=936"@E+afl<EH1>?6�7�W0q]6�<=6Jn-FI6Q'*687=R"<=)?`e6 9(HaF .0{��y9(+1%('*>?6�7�+1Rr@=)?:16"f[(+J7=7=)O:J6+-%('�'3+-@=)?:16^RrHJ%(7N@=<E4(Rk@E)OHJ%(7"n5+-%('dFQ9*flZ/Ha:16"Z/6�%J@])?%Uc\436�7N@=)?H1%(7�Wtgh6K+1>?7=H'*),7=R"4(7E7 BD6�+a@E43<E6�7Q+-%5'bBD68+a@E43<=67N@=<E4(Rk@E43<E6�7�n3+-%('�43%3)OT5R"+-@=)?H1%�W

� �� ��������������� ��!"�#�.0{�� 9(+J7t`e6"6�%�'*687N)?21%368'_`PA "+-[3>,+-%�+1%('*W <E6�7=%(+-%�� v ª #Jz �pFQ)}@E9�+K:\)?6"F @=HK[(<=H1f:P)?'36I+]R"H1Z/[34*@L+a@=)?H1%5+->-BDHJ<=Z_+1>O),7NZ BDH1< +-%(+1>OA ��)O%32]7=6"%\@E6"%(R"6�7�)?%^%(+-@=43<L+->J>?+1%32145+-216JWXG936 Z_+-)?%^[3<EH1`3>?6"Z )O@�+J'3'*<E6�7E7N687�),7093HaFs@EHY6"V\@E<E+JRk@ 21<L+-Z/Z_+a@=),R"+1>1<E6">,+a@E)OHJ%(7�BD<EH1Z+U7=6"%\@=6�%(Rr6JW�$l@K[eHJ7N@=4(>?+-@=6�7@�FIHU>?6":J6">,7H-BG<=6�[3<E6�7=6"%\@E+-@=)?H1%�uHJ%36_`(+17=6�'hHJ%�RrH1%3f7N@=)O@=436�%J@]7N@=<E4(Rk@E43<E6i+1%('_@E936CH-@=9(6"<GH1%�21<L+-Z/Z_+a@=),R"+1>(BD4(%(Rk@E)OHJ%(7Q7N45RL9�+17G7=43`�(�68Rk@�nH1`,(�6�Rk@8W � [(+-<=@=),Rr4(>?+1<t7NHJ43<LRr6QH-B0'3)}��Rr4(>}@�A�)O%�op%32J>O),7N9/),7p@E936QB�+JRk@t@E9(+a@ [5H\7N)O@=)?H1%57+-<E6C4(7=6�'bBDH1<]RrH*'*)?%32/`eH-@=9d@E936r@L+/<=6�>?+-@=)?H1%(7G+17GF 6">?>�+17 @EH1[3),R"+1>O)���+-@=)?H1%d6r@LR-W �IH1%3f7=)?'*6�<E+1`3>?6#6"�eHJ<N@9(+J7C21H1%(6#)?%\@=HU'*6�7=)?21%�H1B .m{�� 7NH�@=9(+-@^)}@^R�+-%s'*6�+1>�FQ)}@E9h+1%('7=6"[(+1<E+-@=6S@=93687N6C@�F H/�\)?%('37GH1B )?%*BDHJ<=Z_+a@E)OHJ%�W

.0{���+->,7NH^)?%('*),R"+-@=687t93HaFw@E936Y2J<E+1Z�Z_+-@=),R"+->3BD43%(Rk@E)OHJ%(7 R"+-%b`56SZ/+1[3[e6�'_HJ%J@EH@=9(6r@E+K<=HJ>O687"W�W 4*@I9(6"<E61n1)O@GH-��6"<L7�%3H^@E936"HJ<=AJn-@E936YZ_+-[([3)O%(2KZK457�@ `56S6"%P43Z/6"<L+a@E6�'6rV*9(+14(7N@=)?:16">?A�)?%b@E936>?6rV*)?R"H1%�W� Z_+:(�HJ<t7N@=<E6"%321@=9_H-B�.m{�� )?7p@=9(+-@I)O@t21)?:1687�6rV*[3>?),Rr)O@ +->?21HJ<=)O@=9(Z/7 BDHJ<t6"V\@E<E+JRk@=f)?%32_21<L+-Z/Z_+a@E)?R�+->�BD43%(Rr@=)?H1%(7�WG$l@Y4(7=6�7]R"H1%\@=6"VP@]BD<=6�621<L+-Z/Z_+-<^� � {��� BDHJ<Y7N[e6�R")}fv1v ª

Page 132: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v8z[� ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

BDAP)O%(2dR"H1%(7N@=)O@=436�%\@i7N@=<E4(Rk@E43<=6JWiop��Rr)?6"%\@i[5+-<L7N)?%32b+1>O2JH1<E)}@E93Z_7QBDH1< � {�� +-<E6^FI6�>O>�P%3HaFQ%U�D6JW 25WOn\ot+-<E>?A�� v ª � � �kn �IH*RL�16Jn �pH14(%3216�<�n "+J7=7E+-Z/)3+1>O2JH1<E)}@E93Zj�D)?% �pH14(%3216�<� v ª � �-�N�rn\XmH1Z/)O@E+d� v ª # � �N�rW .m{�� 4(7=6�7t@=9(6S[eHaFI6�<NBD4(>e4(%3)}TeR"+a@E)OHJ%�Z/6�RL9(+1%3),7NZ�BDHJ<7=[568Rr)OBDA\)?%32~Z/+1[3[3)?%32�@EH�21<L+-Z/Z_+a@E)?R�+->I<=6�>?+-@=)?H1%(7�W�XG936�7E+-Z/6�Z�68RL9(+-%()?7=Z 4(%3)}fBDH1<EZ/>OA/9(+1%('*>?6�7IRrH1%57�@E<E+1)O%\@E7I+1R"<=H\7=7pR"H1%(7N@=)O@=4(6"%\@E7I)O%b@=936iRrHJ%(7�@E)}@E436"%\@Q7�@E<=45Rk@=4(<=6JWXUHJ<=6_)?Z/[5HJ<N@L+-%\@=>?A1n�+->?21HJ<=)O@=93Z_7i@E9(+a@/7NHJ>O:J6#@E936�7=6bR"H1%(7N@=<L+-)?%\@E7+-<E6�RrHJZ/[3>O6"@=6�>OA7=[568Rr)OT(6�'�W� F 6�+1�\%(6�7E7�H-B�.0{�� )?7p@=9(+-@t)}@G'*HP6�7�%(H-@IH1�e6�<t+-%PAK@=936�H1<EA#<E6"2\+-<L'*)O%(2i>?6rV*),R"+1>+-Z#`3)?2143)O@�A1n*+1':(�43%(Rk@L7G+-%('bH1[*@E)OHJ%(+->5@=936"@E+#<=HJ>O687"nP+-%5'�Z_+-[3[()O%32#BD<EH1Z 21<L+-Z/Z_+a@=f),R"+->m<=6�>?+-@=)?H1%(7Q@=H_@E936r@L+_<=HJ>O687"WGXG93687N6@L+17=�*7Y+-<E6>?6rB @YBDHJ<Q@=9(6K>?6rV*)?R"H1%�FQ)O@=9�.m{��H-��6"<E)?%32�%3H�>O)?%3214()?7N@=),R)?%(7N)?219\@C+17Q@EHb93HaF�@EH�'*H_@E936"Z�Wi$&%UB�+1Rr@�ne)}BIH1%36^F 6"<E6@EH6rV*9(+14(7N@=)?:16">?Ab6�%P43Z/6"<L+a@=6^@=936#[5H\7=7=)O`()O>?)}@E)O687"ne)?%U@=936#>O6"V*)?R"H1%�@=9(6#7=H1>?4*@=)?H1%UF H143>,'`e6^RrH1Z/[343@E+a@E)OHJ%(+->?>?A�6rV*[e6"%(7=)O:J6i@=HPH(W$&%C@=9()?7 RL9(+-[3@=6"<mFI6IFQ)O>?>JBDHPR"4(7�HJ%K7=H1Z/6t7=6">?6�Rk@E6�'^+J7N[e6�Rr@E70H-B(op%(21>?)?7=9�n8%(+-Z/6">?A1n@�F H�@�AP[e6�7H1B Z/Ha:J6"Z/6"%\@E7�nm+1%('s7N6�6_93HaF .m{��j9(+-%5'*>O687C@=9(6"Z�W�XG936/BDHJ>O>?HaFQ)?%32+-<E6i@=936Z/Ha:J6"Z/6"%\@E7 H1B )?%\@=6"<E6�7N@Q936"<E61uv W]+1Rk@E)O:J6rfl[(+17E7=)O:J6S+-%5'�'3+-@=)?:16RrHJ%(7N@=<E4(Rk@E)OHJ%(7z WQFQ9*f Z/Ha:J6"Z/6"%\@G)O%�FQ9*f&c\436�7N@=)?H1%(7

W 6rBDHJ<=6^2JH1)?%32�)?%\@=H�@E936/.0{�� BDHJ<=Z_+1>O),7NZ�ne)}@C),7S+1[3[3<EH1[3<E)?+-@=6@EHbZ_+-�J6K+_BD6�F H1`3f7=6"<E:;+-@=)?H1%(7 HJ%�@E936[3936�%3H1Z/6�%(+#@=H/`566"V*[3>?+1)O%(6�'�W��<@?3<@? � � Q,D � ��� �9GTR R D�� �CG ���KGPQ,D�� �IM � �R[Q�BEJ � Q,D�� �R� 7]6rV3+-Z/[3>?6�7GH1B +1Rr@=)?:16"f [(+J7=7=)?:16SR"H1%(7=),'*6"<G@E936^7N6�%\@=6"%5Rr6�7� � � � |!��� � { � }�{ |!�>�.� �;� �7��} � ���;z � � � � |!�7�A� �!{ � � � � } � �;� �7�;} � ���;z |>� { |!��� �P6�%J@E6"%(R"6b� z �QR"+1%�`56K@=93HJ43219\@]H-Bp+J7]+�7=6"%\@=6�%(Rr6C@E9(+a@Y95+17]`e6"6�%UH1`*@L+-)?%36�'�BD<EH1Z)O@E7b+JRk@E)O:J6�RrH14(%J@E6"<E[(+-<=@�� v �/`PA�Z/Ha:P)O%(2~@E936�HJ`�(�6�Rr@7) +�`5HPH1� +�@EH @=9(6�7N4(`�(�6�Rr@[eHJ7=)}@E)OHJ%�ne+1%('�R"H1%P:16�<N@E)O%32/@E936#7=43`�(�68Rk@V) +_`eHaA +5+J7S+_[(<=6�[5H\7N)O@=)?H1%(+1>�[393<L+17=6K+1%('Z/Ha:P)O%32U)O@^@EH�+aB @E6"<K:J6"<E`�W9XUH1<E6"Ha:J6"<8n�H1[*@E)OHJ%(+->?>?A1n�@E936b>,+a@=@=6�<KR"+1% `56b'3<=HJ[3[568'+->O@=HJ216"@=936�<]+17Q7=93HaFQ%�`\Ad7N6�%\@=6"%5Rr6_� y �kWt$&%dB�+JRk@�n5)O%d@E936^[(+J7=7=)O:J67N6�%J@E6"%(R"61n3`eH-@E9H1`,(�6�Rk@]+1%('�@=936 ) `PA +*[(<=6�[5H\7N)O@=)?H1%(+1>�[393<L+17=6iR�+-%�`e6^'*<=HJ[3[e6�'�W� B � � |!�7�A� �!{ � � � � } � �;� �7�;} � ���;z � �%� � |!�7�A� �!{ � � � � } ��� ��} � �>}7�1�;{,� $&%�'3+a@E)O:J6CR"H1%(7N@=<E4(Rr@=)?H1%�nP@E936"<E6^+-<E6Y@�F H/H1`�(�68Rk@L7"W

� � � � |!��� � { � } �7�;} � �A�;z�{ |;�>�A� XG93),7YR�+-%�+-2\+-)?%�`56KR"H1%(7=),'*6"<E6�'�@=Hb`56#H1`*@L+-)?%36�'�`PAdZ�Ha:J6"Z/6"%\@]H1B�) @=H +([3<E6"[eHJ7=)Of@=)?H1%5+->�[39(<E+J7N6+17Q@=936HJ`�(�6�Rr@�n(+1%('d6�+-<E>?)O6�<QH1`�(�68Rk@Y+17GHJ`�(�6�Rr@ z W � %3H1@=936�<][(+J7=7=)O:J6BDH1<EZj),7][eHJ7E7=)O`3>?6H1%U'3+-@=)?:P)��8+a@=)?H1%0WIo�V3+1Z�[(>O67=6"%\@=6�%(Rr687QFQ)}@E9�@=936K[(+17E7N)?:16iBDHJ<=Z+-<E6C21)?:16�%b)?%s� � �G+1%('~�$�-�rW

Page 133: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� �,���?���� ��#$&��� � ��� � � v8z3v� � � � �;} � ���;z�;{ � � � � } � { |!�7�A� |�� { |!�,� � � � � �;} � ���;z�;{ � � � � } � { |!�7�A�

��<@?3<>= � N � � � � ��� � Q D ���J�� R Q�D � R$&%�+_FQ9*f&c\436�7N@=)?H1%0n3@=9(6^FQ9*fl[393<L+17=6^RrH1%\@L+-)?%3)O%(2/@=936�cJ4(6�7N@=)?H1%368'�6�>O6�Z/6"%\@YZ/Ha:1687BD<EH1Z )O@E7Q%(H1<EZ/+1>�[5H\7N)O@=)?H1%�@=H�@E936CBD<=HJ%\@]H-B0@E936^7=6"%\@=6�%(Rr6JWo�V3+1Z�[(>O687 +1<=6i@E936CBDH1>?>OHaFQ)?%32/7N6�%\@=6"%5Rr6�7k�� � � � !{2� � �7z>z7}����>�!���� � � � �!��!��� ;{P� � �7z7z��� ��� � � �!�A�!{ �n� {����� !{P� ���7z>z7}-���7�!���� �7� � � �!��!�� �;���!{ �n� {��� !{P� ���7z>z7}-���� �.� � � �!��!�� �;���!{ �n� {�� � ���;{2� |;}�z���} � }-�� !{2� � �7z>z,}-���� 7I7N6�%\@=6"%5Rr6K� v8z �p7N93HaF]7�n1FQ93f 6�>O6�Z�6�%\@IR"+1%_Z�Ha:J6^��+1<=`3)O@=<L+-<E)?>OA3�m>OHJ%32K'*),7N@E+-%5Rr6])?%R"+J7N6CH1B ��+1<=`()}@E<E+1<=)?>OA�'36"6"[e� 6"ZK`e6�'('*6�'�7=6"%\@=6�%(Rr687"W� .- � �"0]� ��!]0 ��� � �K4.0{�� +17E7N)?21%57_@�F H�<=6�[3<E6�7=6"%\@E+-@=)?H1%(7���+a@�@�FIH '3)}��6"<E6"%\@�>?6":J6">,7E�_@=Hw+�7N6�%\@=6"%5Rr61WXG936�Ad+1<=6R"+1>O>?6�'�Rrfl7N@=<E4(Rk@E43<E6�� BDH1<iRrHJ%(7�@E)}@E436"%\@Y7N@=<E4(Rk@E43<E68�Q+1%('�B fl7N@=<E4(Rk@E43<E6�� BDH1<BD43%(Rr@=)?H1%(+1>Y7N@=<E4(Rk@E43<=6;�kW XG9(6�BDH1<EZ�6�<_)?7b+�@E<=6�6�7�@E<=45Rk@=4(<=6�FQ93),RL9y7N93HaF]7/F H1<L'H1<L'*6�<i+1%('�9()O6�<E+1<ERL93),R"+1> 7N@=<E4(Rr@=43<E6#H1B R"H1%(7N@=)O@=436�%\@E7�W#XG936/>,+a@N@E6"<),7C+d7N@=<E4(Rr@=43<E6RrHJ%\@E+-)?%3)?%32U+U7N6"@^H-BQ+a@=@=<E)O`343@=6_:a+->?436_[(+1)O<L7"nm+-%('h)O@^Z/+;Ah+->,7NH�`e6_93)?6"<L+-<LRL93)?R�+-> W�IH1%57N),'*6"<]7=6"%\@E6"%(R"6/� � �G+1`5Ha:J61n*+17Q+1%�6"V*+1Z/[3>O6JW� � � � |!��� � { � } �7�;} � �A�;z�{ |;�>�A� $l@E7�Rkf&7N@=<E4(Rk@E43<=6�)?7�7=93HaFQ% )O%w{ )O2J43<=6 # W v ��+J�kW~$l@#9(+J7^@E936d4(7N45+->G7NAP%\@E+JRk@=),R�+1%('>?6rV*)?R�+->�R"+-@=6�21H1<E)?6�7�WiXG936#@=<E6"6�6"%5RrH*'*6�7i93)?6"<L+-<LRL93),R"+1>m+17iF 6">?>�+17SFIHJ<E'UHJ<E'36"<i)O%*fBDH1<EZ_+a@E)OHJ%�W�XG936^RrHJ<=<E6�7=[5HJ%('*)?%32^B f&7N@=<E4(Rk@E43<=6C),7Q21)?:16�%�)?%U{ )O2J43<=6 # W v �D`5�rW$l@Y9(+J7G@=9(6K+a@=@=<E)O`343@=6�7Y7N43`,(rn([3<E6�'�n(@=6�%(7N6Jn(HJ`�(rn(HJ`�( z n(7=[e6�R-n56r@LR-WQXG936:a+->?436�7H-BI@=936�+-@N@E<=)?`34*@E6�7+-<E6_7N9(HaFQ%�%36"V\@@EHd@=936�ZdWb�*43`�(rn0HJ`�(rn0+1%('hH1`�( z +-<E6�R�+->?>O68'21<L+-Z/Z_+a@E)?R�+->eBD43%(Rr@=)?H1%(7]`568R"+-457N6i@=9(6"A�+1<=6C7=[568Rr)OT(6�'d`PA_@=9(621<L+-Z/Z_+-<Q+-%('�%3H1@`PA/@=936C>?6rV*),RrH1%0W��t<=68'_),7 +�7=[568Rr),+->�+a@=@=<E)O`343@=6i@=9(+-@QZ/+1[(7I@=H/7N6�Z_+-%\@=),RY<E6"[(<=687N6�%*f@E+-@=)?H1%BD<EH1Z @E936IB fl7N@=<E4(Rk@E43<E61W0$l@L70:a+1>O436 ),7�@E936I[(<=68'*)?R�+a@E6I+-<E214(Z�6�%\@ RrHJZK`3)?%(+-@=)?H1%BDH1<p@=936QB f&7N@=<E4(Rk@E43<=6JW�{3<EH1Z @E936Y+1`5Ha:J6GB fl7N@=<E4(Rk@E43<E61n1F 6]R"+1%/H1`*@L+-)?%/@=936QBDHJ>O>?HaFQ)?%32[3<E6�'*),R"+-@=6+-<E214(Z�6�%\@G<E6"[(<=687N6�%J@L+a@E)OHJ%��D)?21%3HJ<=)?%32_7=[568Ri+1%('�@=6�%(7N6;�ku

� � � } � |!�,� � |!�>�A� �x� ���;z �$lB�FI6i@E+1�16i@=9(6[(+17E7N)?:16C7=6"%\@=6�%(Rr6_� � �

� � � � �;} � ���;z�;{ � � � � } � { |!�7�A� |�� { |!�,� � �e�l�;� ��� ¥ � � ���k�1� � � ¥ �8� � ���;� ¤ �1� ¥ � * � � ×Q¥ �L� � � ¥ �� ¥ � � ���k�1� � � �E��� � ¥3×]� � £k¥ � � �m¢ � � � � ¥�L¤ � �� k� �0� � ¥ � �;� ��� ¥ � � ���k�-� *

Page 134: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v8zJz ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

'*6"@K� � � % �D`eHaA3��D© � W � z � ©1©5n � � W ª � �[� �"� v � W z�������y n � �r��© � W � z � ©1©(n � � W ª �[�[� �r� � �PW z:�Jz # � n � �

�S�

:h�D2\+;:168� �Y� � @E93621)?<E>,� �Y� ��+/`eHPH1�3�� v �\z W y �[� � # n � � W ª � � � �"� v �PW�� � � #1z n � �r� v �Jz W y[� � � # n � � W ª �[�[� �r��ª z W � �;y ª # n � �"� v �\z W y ��� � # n � � W ª � �[� �"� v � �\W v © v #[� n �

� v �!y W y � # ©\ª3n � � W ª � �[� �r��© � W � z � ©-©(n � �"� v ��y W y�� # ©Jª*n � � W ª � �[� �"� z1z ©3W z �3v,y n � �

��+\�kutRrfl7N@=<E4(Rr@=43<E6��������������������

� ����� � � ��� � ������� � � � � ������� � ����� � ���� � � ��� � � ��� z � � ����� ��� � � ��� ���� ��� z � ����� ����� � � � ���"!#���� ��� � ��� � �%$������� ���&�'��()� �

*,++++++++++++++++++-�D`5�ru�B f&7�@E<=4(Rr@=43<E6

{ )O2J43<E6 # W v uTUQ6"[3<E6�7=6"%\@L+a@=)?H1%�H-B�7N6�%\@=6"%5Rr6_� � �

Page 135: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

������� � � � � �� � �� $�� � v8z!y@=9(6�T(%(+1>-[3<E6�'*),R"+-@=6rf&+-<E214(Z�6�%\@�<E6"[(<=687N6�%J@L+a@E)OHJ%YZK457�@0<E6"Z_+1)O%i@=9(6t7=+1Z/6p+17�`e6rBDH1<E61u

� � � } � |!�,� � |!�>�A� �x� ���;z �)?%('*),R"+a@E)O%(2^@=95+a@t@E936 ) 21<EHJ7E7 +-Z/6�+-%()O%32KH-B0+1Rr@=)?:16Y+1%('/[(+J7=7=)O:J6]<E6"Z_+-)?%(7�@E936i7E+-Z/6JWXG93),709(H1>,'370)?%(7=[3)O@=6tH1B*@=936G'*)O�e6�<=6�%\@ Rkf&7N@=<E4(Rk@E43<=6I+-%('CB f&7N@=<E4(Rk@E43<=6tBD<=HJZ @E936G+1Rk@E)O:J67=6"%\@=6�%(Rr6Ju� 7�@=936tB fl7N@=<E4(Rr@=43<E6t)?%^{ )O2J43<=6 # W z )O%5'*)?R�+a@E6�7 ��7=6"6p:a+->?436870H1BP[(<=68'(��@E936"<E6tF H143>,'`e6^+a@Q>O68+17N@G@�FIH�>O6"V*)?R�+->�6"%\@E<=)?6�7 BDHJ<Q21)?:161u H1%(6CR"H1<E<=687N[eH1%5'*)O%(2K@EH#@E936^+1Rr@=)?:16i4(7=6+-%5'd@=936^H1@=936�<Q@=Hb[(+17E7N)?:16457N6)?%�'3+-@=)?:16^RrHJ%(7N@=<E4(Rk@E)OHJ%�Wi��$&%�B�+1Rr@�n5@=936�<=6^FQ)?>?>0`e6@�F H�Z/H1<E6b>?6rV*)?R�+->I6"%\@=<E)O687BDHJ<#%3HJ<=Z_+1>I+1Rr@=)?:16b+1%(' [(+J7=7=)?:161n�+1%('�7=6":16�<E+1>pZ/H1<E6@=H�@E+-�J6�R"+1<=6UH1BCHJ[*@=)?H1%5+->YHJ`�(�6�Rr@b+-%(' [(<=6�[5H\7N)O@=)?H1%(+1>][393<L+17=6�7�)O% R�+17=6�H-BC@=9(6[(+J7=7=)O:J6�7�W �� �� � �K4 ���K� � ����! 8 �.0{�� BDHJ<=Z_+->?),7NZ 9(+J7 @�FIH�Z_+:(�HJ<GR"H1Z/[eH1%36�%J@L7"n*+�212\RrHJ%J@E6rVP@tBD<E6"6C2J<E+1Z�Z_+1< +1%('+�BD43%(Rr@=)?H1%(+1>m7=[568Rr)OT5R"+-@=)?H1%�W XG936CBDH1<EZ/6"<]2J)O:J6�7 @E936KRkf&7N@=<E4(Rk@E43<=6iBDHJ<Y+_7N6�%\@=6"%5Rr61n+-%5'd@=936^>,+a@=@=6�<Y21)?:1687G@=9(6B fl7N@=<E4(Rr@=43<E61WQXG936@�F H�RrHJZ/[5HJ%36"%\@E7S+-<E6)O%\@E6"<E<=6�>?+-@=6�'�n93HaF 6":J6"<8ne+1%('U@E936KB f&7N@=<E4(Rk@E43<=6#)?7i[3<EH*'*4(R"6�'�`PAU4(7=)?%32�BD43%5Rk@=)?H1%5+->�7N[e6�R")}TeR"+a@E)OHJ%@=HJ216"@=936�<QFQ)}@E9�@E936^Rkf&7N@=<E4(Rk@E43<=6JWXG936�BD4(%(Rk@E)OHJ%(+->\7N[e6�R")}T5R�+a@E)OHJ%(7�4(7=4(+1>O>?AiR"H1%(7=),7�@0H1B*6�c\4(+->?)O@=)?6�70+J7=7=H*Rr),+a@E6�'iFQ)}@E96�+JRL9�%3H1%*f @=6�<=Z/)?%(+->�HJ%�@=936K<=)?219\@Nfl9(+1%('�7=),'*6H-B�@=9(6KRrHJ%J@E6rVP@QBD<E6"6�� � {��]<=43>?61WI$&%@=9(6i6"V3+-Z/[3>?6S2J<E+1Z�Z_+1<pBD<EH1Z "+-[(>?+1%b+-%(' W <=687N%(+1%�� v ª #\z �t21)?:16"%b`56�>OHaFn\@=9(6"<E6+-<E6G@�F H^7N[e6�R")?+1>(7NAPZ#`5HJ>?7�u043[3fl+1<=<EHaF�+1%('/'*HaFQ%*f&+-<E<=HaF ��R"+1>O>?6�'�Z/6r@L+afl:;+1<=),+-`(>O687E�rWXG936 '*HaFQ%*f&+-<E<=HaF�)?%K+GBD4(%(Rk@E)OHJ%(+->P7N[e6�R")}TeR"+a@E)OHJ%^+17E7NH*R")?+-@=6�'CFQ)O@=9#+Q%3H1%3f�@E6"<EZ�)?%(+1><E6rBD6"<L7C@EH�@=936_B f&7N@=<E4(Rk@E43<=6bFQ)}@E9s@=936�%(H1%*f @=6�<=Z/)?%(+-> nmFQ9()O>?6/@=936�43[*f&+-<E<=HaF <=6"BD6"<L7@=HY@=936IB f&7�@E<=4(Rr@=43<E6I+J7=7=H*Rr),+a@E6�'CFQ)O@=9^@E936I7=APZK`eH1>\H1%@E936 >O6"B @Nfl9(+-%('#7N),'*6IH-B*@=9(6�� {

<E43>O6JW

� U v �Q� � �Y� �S�� 7=43`�( ��� � ���� U z � �S� � � � �Y��� � �Y��� �t� �� H1`,( ��� � H1`�( z ��� � � � [�R"+J7N6;� ��� H1`�(� U y �G�t� � [3<E6"[ �Y�� H1`�( ���� U]©\���Y� � '*6"@ %3HJ43% � [3<EH1%3HJ43%UQ43>?6b�>U v �Y7=+;A*7G@E9(+a@S+b7N6�%J@E6"%(R"6b���(�]RrHJ%(7=)?7N@E7YH-Bp+_%3HJ43%U[393<L+17=6b� �S�I� BDHJ>}f>?HaFI68'�`PAd+_:16�<=`�[393<L+17=6�� �i�I�rW5XG936BD4(%(Rk@E)OHJ%(+-> 7N[e6�R")}T5R�+a@E)OHJ%�+J7=7=H*Rr),+a@E6�'dFQ)}@E9@=9(6��S� 7=+;A*7t@=9(+-@Q@=936iB f&7�@E<=4(Rr@=43<E6SBDH1<]��95+17Q+-%d+a@=@=<E)O`343@=67N4(`�(IFQ93H\7N6i:a+->?436C)?7@=9(6/B fl7N@=<E4(Rk@E43<E6/BDH1< �Y��WmXG9\457"nm@=936/B f&7N@=<E4(Rk@E43<=6/BDHJ< �Y� ),7C@=9(6�7N43`,(�6�Rk@^)?%s@=9(6B f&7�@E<=4(Rr@=43<E6QBDHJ< ��WPXG936S7=6�R"H1%('_7=[e6�Rr)OT5R�+a@=)?H1%�7=+;A*7�@E9(+a@I@=936YB fl7N@=<E4(Rk@E43<E6�7�BDHJ< �i�+-%5'd�d+-<E6C6�c\4(+1>�W$&%�<=43>?6^� U z �kn1`5H1@=9 �Y�I7�+-<E6IHJ[*@=)?H1%5+-> n-FQ93),RL9/+1<=6IBDH1>?>?HaFI68'K`PA^[3<E6"[eHJ7=)O@=)?H1%(+1>[393<L+17=6����t� �]<E6"[e6�+-@=)?%32��"6"<EHbHJ<CZ�HJ<=6K@=)?Z/6�7�W#XG936 �Y�I7CRrH1%\@E<=)?`34*@E6K@EH�HJ`�(�6�Rr@H1<QHJ`�(�6�Rr@ z n*)O%d@=9(6SB f&7N@=<E4(Rk@E43<=6H1B0@E936^7N6�%\@=6"%5Rr61n3�I�t7Q+1<=6C7�@EH1<E6�'d+17Q+J' (�43%(Rr@�W

Page 136: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v8z © ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

'*6"@K��XG936;� % ��21)?<=> �� �[� W ª � � ª # n � � W ª � �[� �"� z3v W v-v1v-v � n � �r� ��� W ª � � ª # n � � W ª �[�[� �r� # � W z ©1© � n � �

�Y�

:~�DFG+17L�

:���21)?:16�%5� �S� ��+�`eH\HJ�3�

[3<E6_�D`PA3� �Y� ��+/`eHaA3�� � � W #[� ª+� # n � � W ª � �[� �r� v �PW �;ª v �Pn � �r� � � W #[� ª+� # n � � W ª � �

� v,yJz W © v � ©1©(n � � W ª � � � �r� v ª3W � #�y!y �*n � �"� v7yJz W © v � ©-©(n � � W ª � �[� �"��ª � W v�# ª �(v n � �r� v,y1z W © v � ©1©(n � � W ª �

� v �\z W � #[� � z n � � W ª � � � �r� v � W v�y%# ª z n � �r� v �Jz W � #[� � z n � � W ª � ��� �r� v ª y W v © �[�*v n � �

� zJz �*W ª v © v n � � W ª � �[� �"� �[� W ª � �\n � �"� zJz �PW ª v © v n � � W ª �[� � �r� z ª y W � ©+�;© �Pn � �

��������������������

� � ��� � � �%���� �%$������� �����'��()��������� ���&� � � � � � � ��� ��� �%� � � �����P� ��� � � ��� ���� ��� � ����� ����� � � � ���"! �,�� � � ����� ������� � � � � � �

*,++++++++++++++++++-{ )?2143<E6 # W z u �tfl7N@=<E4(Rr@=43<E6+-%('bB fl7N@=<E4(Rr@=43<E6iBDH1<Q[(+J7=7=)O:J67N6�%J@E6"%(R"6_� � �

Page 137: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� ���I� ���#����� �� � � ��%��=� � � ��%��$]P$]��% � v8z �XmHiHJ`*@E+1)O%#@=9(6IB f&7N@=<E4(Rk@E43<=6Jn-F 6 Z#4(7N@p4(7N6 @E936GBD43%(Rr@=)?H1%(+1>37N[e6�R")}T5R�+a@E)OHJ%�+1>OHJ%32FQ)O@=9C@=9(6tRkf&7�@E<=45Rk@=4(<=6JW �IH1%(7=)?'36"<0+J7�+-%C6rV3+1Z�[(>O6Jn87=6"%\@=6�%(Rr6]� � �eFQ93H\7N6pRrfl7N@=<E4(Rr@=43<E6),7#2J)O:J6"%�)?%�{ )?2143<E6 # W v ��+\�kW .�6"@#B v `56�@=9(6�B f&7N@=<E4(Rk@E43<=6�H-B]@E936�7N6�%J@E6"%(R"6�+1%('B z @E9(+a@KH1BQ@=936 �Y��WmXG9(6"<E6rBDH1<E61n H1% 457N)?%32�@=9(6�7=43`�(�6�Rr@#7=[568Rr)OT5R"+-@=)?H1% H-BG@E936bRkf7N@=<E4(Rk@E43<=6CF 6C216r@8u

��� � �>| � � �;��P)?Z/)O>,+-<E>OAJn�H-@E936"<68c\4(+a@E)OHJ%(7R"+1%~`e6_FQ<=)O@N@E6"%s'*HaFQ%�W_XG936/@E6"<EZ�)?%(+1>?7+1>?7=H�AP)?6">,'6�c\4(+-@=)?H1%(7�np4(7=)?%32�@E936�>O6"V*)?R"H1%�W��*H1>?4*@=)?H1%�@=H~@=936�68cJ45+a@=)?H1%57#),7/+-%�B fl7N@=<E4(Rr@=43<E67=93HaFQ% )O%w{ )O2J43<=6 # W v �D`5�rWs$l@#),7#+J7=7=H*Rr),+a@=68'sFQ)}@E9 @=9(6�<EHPH-@K%3H*'*6�� )?% @=9(6�Rkf7N@=<E4(Rk@E43<=6JW�PHJZ�6C6"V*+1Z/[3>O6C>?6rV*),RrH1%d6"%\@E<=)?6�7Q+1<=6Ju@=936Jn�'36r@� 7=[568R � @E936`5HaAJn %(H143%� [3<E6�' � ) `eHaA +� %P43Z � 7=)O%32J43>,+-<� N� � 0 ��� � �-�K� � 0]���90�8P8 � �#����!k��!"�#�98XG936YB fl7N@=<E4(Rk@E43<E6S+17E7=)O2J%36�'/@EH#+#7N6�%J@E6"%(R"6YZ#4(7�@Q7E+a@=),7NBDA/R"6"<=@E+1)O%�F 6">?>Of�BDHJ<=Z/6�'3%36�7E7RrHJ%('*)O@=)?H1%(7�W0$lB�+-%PACH-B5@=93687N6GRrHJ%('*)O@=)?H1%(7 +-<E6I:P)?H1>,+a@E6�'C@E936Q+17E7N)?21%3Z/6�%J@ )?7 <E6&(�68Rk@=68'+-%5'�+1%�+1>}@E6"<E%(+a@E)O:J6i7N@=<E4(Rr@=43<E6C)?7Q6"V*[3>OHJ<=68'�WXG936_T5<E7N@#RrHJ%('*)O@=)?H1%s@E9(+a@�ZK4(7N@K`e6�7E+a@=),7NT(6�'s`PAs+-%sB f&7�@E<=4(Rr@=43<E6�),7@E9(+a@�H-B � ��� � � �� �kWU$l@/7=+;A*7C@E9(+a@#+1%�+a@=@=<E)O`343@=6b)?% +1%sB fl7N@=<E4(Rk@E43<E6bR"+1% 9(+;:16�+-@KZ/HJ7N@H1%(6U:;+1>O4(61W {3HJ<�6rV3+-Z/[3>?61nG)OB)}@b),7�<E6�c\43)?<E6�'�@=9(+-@�@=9(6UBDH1>?>OHaFQ)?%32sB f&7�@E<=45Rk@=4(<=687��R"H1<E<=687N[eH1%5'*)O%(2K@EH ) `eHaAP7 +3+-%5' )�+,+��I`56Z_+J'*66�c\4(+1>�W

� � � � ��( � ���&(������ � � � � � � � � � � � � � ()�������� � �

)O@ FQ)?>O>eB�+1)O>e@=H#AP)O6�>?'�+#R"H1%(7=)?7N@=6�%\@tB f&7�@E<=4(Rr@=43<E6Y`e6�R�+-4(7=6YH1B�@=9(6iR">?+J7N9�)?%�@E936i:;+1>O4(6H-B�+a@=@=<E)O`(4*@=6%P43Z�W �YH-@=6HJ%d@=936H1@=936�<Q9(+-%('�@E9(+a@Q@E936B f&7�@E<=4(Rr@=43<E6�7G)?%U{ )O25W # W y��+\�GR"+1%�`e6Z_+1'*6C6�c\4(+1>�@=H_AP)?6">,'b@E936CB f&7�@E<=4(Rr@=43<E6C)O%U{ )?2(W # W y �D`5�rW

� � � � � � � � � ()��������� � � � � � � � � � � � � � ()�������� � �

{m)?214(<=6 # W y ��+\�kup{mfl7N@=<E4(Rr@=43<E6�7 BDHJ< ) `eHaA +3+-%(' ) +E+

Page 138: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v8z � ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

{ )O2J43<E6 # W y ��`5�ku3UQ687N4(>}@E)O%32/B f&7N@=<E4(Rk@E43<=6CHJ%�43%()}T5R�+a@E)OHJ%dH1B0B f&7�@E<=45Rk@=4(<=687GH-B�) `eHaA ++-%5' )�+,+{m)?214(<=6 # W y u � %U6rV3+-Z/[3>?6CH-Bm4(%3)}TeR"+a@E)OHJ%�H-B0B f&7N@=<E4(Rk@E43<=687

�� � � � � � � � � ( ��������� � � ���� � � *-

XG93),7[3<EH*Rr6�7E7CH-BGZ_+-�P)?%32d@�FIH�B f&7�@E<=45Rk@=4(<=687C6�c\4(+->t)?7^R�+->?>O68'h43%3)OT5R"+-@=)?H1%�W�$l@FQ)?>O>S`56h'*)?7ERr457=7=6�' )?% '*6r@L+-)?>Y>,+a@E6"<8W XG9(6�43%3),c\436"%(6�7E7bRrHJ%('*)O@=)?H1%y),7b+s2J6"%36�<E+1>Z/6r@E93H*'bBDHJ<]7N[e6�R")}BDAP)?%32�RrH1f H*R�Rr43<E<=6�%(Rr6S<=687�@E<=),Rk@E)OHJ%(7 )O%5Rr>?4('*)?%32�+-2J<=6�6"Z/6"%\@�WXG936�7=6�R"H1%(' RrH1%5'*)}@E)OHJ%y)?7b@=95+a@�H1B � � � � � � � � � �� �kW � [([3<=H;V*)?Z_+a@=6�>OAJn]+-%yB f7N@=<E4(Rk@E43<=6t)?7mRrH1Z/[3>?6r@E6p)OB3)}@mR"H1%\@E+1)O%570+->?>a@E936I+-@N@=<E)?`34*@=687�%(+1Z/6�'C)?%@=936I+-<E2143Z/6"%\@L7H-Bm)}@L7G[3<=68'*),R"+a@E61W�{3HJ<G6rV3+-Z/[3>?61nP)OBmF 6S9(+;:J6]@E936+a@N@E<=)?`34*@E6S[(<=68'�FQ)O@=9�@=936C:a+->?4361u21)?:16 � � � 7=43`�(rn � HJ`�( z n � HJ`�(=� �@=9(6bB f&7�@E<=45Rk@=4(<=6�Z#4(7N@/R"H1%\@E+1)O% :a+->?43687KH1B]@=936d+a@=@=<E)O`343@=6�7�7=43`�(rnpHJ`�(K+-%('�H1`�( z WXG93),7^RrHJ%('*)O@=)?H1% F H143>,'sR"+14(7N6�@E936_BDH1>?>?HaFQ)O%32U7=6"%\@=6�%(Rr687C@=H�`56_<E6&(�68Rk@=68'hBDH1<^6"VPf+-Z/[3>?61u� � |!��� � { � } �7�;} � �A�;z � � |!��� � { � }

�]H1@=6C@E9(+a@Q@E936�7=6CFIHJ43>?'�%3H1@]H-@=9(6"<EFQ)?7=6C`56<E6&(�68Rk@=68'b`PA_@E93621<L+-Z/Z_+-<G<E43>?6�7�WXG936�@=93)?<E' +-%(' T5%(+->CRrHJ%('*)O@=)?H1% <E6">,+a@E6�7_@EH � ��) �� � � � �"W $l@�7N@E+-@=6�7�@=9(+-@d)OB@=9(6"<E6Y),7I+2J<E+1Z/Z/+-@=),R"+1>3BD43%(Rr@=)?H1%�)?%_@E936YB f&7N@=<E4(Rk@E43<=6JnJ)O@IZ#4(7N@ +->,7=H^H*R"Rr4(<t)?%�@=9(6[3<E6�'*),R"+-@=6"fl+1<=2J43Z/6"%\@KRrHJZK`3)?%(+a@E)OHJ%�W�{3HJ<K6"V*+1Z/[3>O6Jn�)}BQ@E936"<E6b),7K+�21<L+-Z/Z_+a@=),R"+1>BD43%(Rr@=)?H1%�H1`�( z n�@=936�% )O@�Z#4(7�@_+->,7=H�H*R"Rr4(<#)?%�@E936�:a+1>O436dH-B][(<=68'�W XG93)?7�F H143>,'R"+14(7=6S@E936CBDH1>?>?HaFQ)O%32/7=6"%\@=6�%(Rr6C@EH�`e6<E6&(�6�Rr@=68'�u� � �;} |!�,� � z,} � � �7�;} |!�>�A�� � �;} |!�,� {,�>}��7�;} { �>� z7}��,�;} � ����z

`e6�R"+14(7=6I[3<E6�'3)?R�+a@=6IBDH1<�7=>O6�6"[�9(+17mH1%3>?AH1%(6 +1<=2J43Z/6"%\@ ��<=6�>?+-@=)?%32Y@EHi7=43`�(�68Rk@k�kn1+1%('@=95+a@QBDH1<Q68+a@Q9(+J7GH1%3>?A�@�F H�+1<=2J43Z/6"%\@E7�WXG936�7N68RrHJ%(' +1%(' @E93)O<L' R"H1%('3)}@E)OHJ%(7/RrH1<E<E6�7=[5HJ%('s@=H~@=9(6r@E+-flR"<=)O@=6�<=)?H1% H-B � W��7=6"6��I95+-[�W v8z � H1<p+1+1�a+1+-%(�P7=9(+J+aflA1H12JAJ+-@E+1+ [3<E)?%(Rr)?[3>?6QH-B���+-%3)?%3)0��7N6�6��I9(+-[�W � W��kWXG936�AbR"+1[*@=43<E6^7=43`*f&R"+a@E6"2JH1<E)��8+a@=)?H1%�+1%('�@=936"@E+-f <EH1>?6i+J7=7=)?21%3Z/6"%\@8W

� �� � �^��� ��!"� � � � � � � �"0 � 0S��� !������90�80��!"�#�98XmH�9(+-%5'*>O6b>OHJ%32�'*),7�@L+-%(R"6�Z/Ha:16"Z/6�%J@8n0@E936"<E6b+1<=6_`eH143%5'*6�'sZ/6r@L+;:a+-<E)?+1`3>O687%3H1f@E+-@=68'�+17#'*HaFQ%�+-%('s4([ +-<E<=HaF]7CFQ)O@=9�'*H143`(>O6�68'*2168's@E+1)O>,7b���tn�� �kW~XG936"As+-<E6

Page 139: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

����� ��� � � � !�E��P$]��%��� � �,����� � v8z �<E6�7=[568Rk@=)?:16�>OA�R"+->?>?6�'wRrH1%\@E<=HJ>O>?6"<_+-%5'wR"H1%\@=<EH1>?>?6"61WyqY6"<E61n FI6�FQ)?>O>YR"H1%(7=),'*6"<_FQ9*fZ/Ha:16�Z�6�%\@G<E6">,+a@E6�'b@=H/FQ9*f&c\436�7N@=)?H1%(7GHJ%3>?A1WXmH�9(+1%('*>?6�@E936�BD<=HJ%J@E)O%(2~H1BYFQ9*fl[393<L+17=6�7#FI6dFQ)O>?>QRL9(+-%(216b<E43>?6 U v @EHOU v +OW� >,7=H(np@E936U2J+1[�>?6rB @�`e6"9()O%('w`PA @E936UZ/Ha:16"Z/6�%J@/FQ)?>O>Q`e6U9(+-%5'*>O68' `PAw+->?>OHaFQ)?%326"Z/[*@�A�%3H14(%�[39(<E+J7N6_��7=6"6�U � �kW� U v + �Q� � � �Y��� �Y� �i�� FQ9 � � � 7N4(`�( ��� � ������ 436�7N@ ���� � �� U � ���Y� � 6� � �W A^'*6rT5%3)O%(2S@E936 B fl7N@=<E4(Rr@=43<E6IH1B3@=9(6 Z/Ha:J6�'^FQ93f [39(<E+J7N6 +17�+SR"H1%\@=<EH1>?>?6"<8n;+1%('K@=9(+-@H-B�@E936�6"Z/[*@�A �Y� +17i+bR"H1%\@=<EH1>?>O6�61neFI6#)O%5'*)?R�+a@E6^@=95+a@i@=936#B fl7N@=<E4(Rr@=43<E6�7S+-<E6^@=9(67E+-Z/61WXG9P4(7�n R"H1%\@=<EH1>?>O6�<�+-%(' R"H1%\@=<EH1>?>O6�6�9(+;:16U+ 7=[568Rr),+->]Z/6�+1%3)?%32 )O% .m{���WtXG9(6Rr>?HJ7=6�7N@p%3687�@E6�'�Z_+a@ERL9()O%32^R"H1%\@=<EH1>?>?6"<�+-%('_R"H1%\@=<EH1>?>?6"6Q+-<E6GZ/+J'*6Q6�c\4(+1>3H1<�4(%3)}T56�'�W��XG9()?7K)?768c\43)O:a+1>O6�%J@@EH�RrHJ)O%5'*6rV*)?%32�)O% H1@=936�<^21<L+-Z/Z_+-<L7"W�� � @=936�<^<E43>O687^+-`eH143@+-2J<=6�6"Z/6"%\@]6"@ER-WiRrHJ%J@E)O%P436K@=H�93H1>,'�W � 7S+1%�)O>?>?4(7�@E<E+-@=)?H1%�R"H1%(7=)?'36"<]@E936^BDHJ>O>?HaFQ)?%327=6"%\@=6�%(Rr687"u

� � ���7�A� |!�,� � } �7�P��} � �;� � �A�!�>�>z�� � �!�2��} � ���7�A� |!�,� � } �7�P��}��;� � �A�!�>�>z � � �!�2� }

XG936bBDH1<EZ�6�<#7=6"%\@=6�%(Rr6�)?7K`(+1'�`568R"+-457N6�H-B]+-2J<=6�6"Z/6"%\@K:P)?H1>,+a@=)?H1% H1BQ@=936�6"Z/[*@�A6">?6"Z/6�%J@]FQ)O@=9d@E936:16�<=`�W

� �� ��� � 6U��� �i��!"�#� ��� � 8�6O0]� �P8� 7 Z/6"%\@E)OHJ%36�'�)O%b@=936C)?%\@=<EHP'34(Rk@E)OHJ%�n*+KZ_+:(�HJ< 7N@=<E6"%(2-@=9�H-Bm.m{�� ),7I@=9(+-@Q)}@G21)?:16876rV*[3>?),Rr)O@/+1>O2JH1<E)}@E93Z_7^`PA FQ93),RL9 Rkf&7�@E<=45Rk@=4(<=6d+-%('�B fl7N@=<E4(Rk@E43<E6�R"+1%�`e6�HJ`*@E+1)O%368'BDH1<S+_7N6�%J@E6"%(R"61W � 7Q)O@Y4(7=6�7 � {���n*@E936^[(+1<E7=)?%32_[3<EH1`3>?6"Z %(+-Z/6">?A1n5+-<E<=)?:P)O%32_+-@Y+Rkf&7N@=<E4(Rk@E43<=6IBD<EH1Z +C7=6"%\@=6�%(Rr6G),7�+i7=H1>?:168'^[3<EH1`(>O6�ZdW��P6":J6"<L+->P6r��R")O6�%J@p+1>O2JH1<E)}@E93Z_7+-<E6C�P%3HaFQ%d+1%('b@=936�)O<Q)?Z/[3>O6�Z/6"%\@E+-@=)?H1%(7]+1<=6+;:a+-)?>,+-`3>?6 �=H-�ef�@E936rf&7=936">OB�W �XG936�B f&7�@E<=45Rk@=4(<=6�H1B*+Q7=6"%\@E6"%(R"6pR"+-%`e6pHJ`*@E+1)O%368'i`\AS4(7=)O%32Y)}@L70Rkf&7N@=<E4(Rk@E43<=6�+1%('BD43%(Rr@=)?H1%(+1>�7N[e6�R")}T5R�+a@E)OHJ%(7t)?%�.m{���W*q]6�<=6JnP4(7N6S)?7 Z_+1'36YH-Bm43%3)OT5R"+-@=)?H1%�n*+#[5HaF 6"<=fBD43>�HJ[56�<E+-@=)?H1%�Wgh6_'*)?7ERr457=7Y@=936/%3H1@=)?H1%~H-BpBD68+a@=4(<=6/7�@E<=45Rk@=4(<=687i+1%('�4(%3)}TeR"+a@E)OHJ%`e6">?HaFWpXG936'*)?7ERr457=7=)OHJ%�),7G`(+J7N68'�HJ% U]6"AP>O6+1%('9UQH193<E6"<� v ª #%# MP$&%\@=<EH*'*4(Rk@E)OHJ%5�kW��<�� <@? � � GPQ�JB � R G��� � � GPQ,J�B�� ��Q�BEJ�� Q,J�B�� R{368+a@E43<=687d9(+;:16~`56�6"% 457N68' )?% >?)O%(2143),7�@E)?R�7�7N)?%(Rr6h>?H1%32w+a@�%36�+1<=>?A +->?>C>O6�:16">,7�H-B>?)O%32J43),7�@E)?RS'*6�7ERr<E)O[3@=)?H1%�W � 7=)OZ/[3>?6Y6"V3+-Z/[3>?6]H-B�BD68+a@=4(<=687t+17E7=HPR")?+-@=68'/FQ)}@E9b+%3HJ43%[393<L+17=6K95+17i`56�6"%h21)?:16�%�)O%s{ )O2J43<E6 # W y )O%�@=936�BDH1<EZ H-BIZ/+-@=<E)}V�<E6"[(<=687N6�%J@L+a@E)OHJ%�W

Page 140: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v8z # ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

$l@_R"+-% `56�6rV*[3<E6�7E7=6�'s)?%�@=9(6bBDHJ<=Z H1BS+�2J<E+1[39�<E6"[3<E6�7=6"%\@E+-@=)?H1% )?%�{ )?2143<E6 # W ©5W

�P)?%3214(>?+1<� v # W � � ª-©Jª(n � � W ª � �[� �"� v # W � � ªa©\ª*n � �

%P43Z

`eHaA�$�PW ª v � � ª(n � � W ª � � � �"� �PW ª v � � ª(n � �

[3<E6�'

+ � z W � n � � W ª � � � �"� z W � n � �

7=[e6�R� � � W ª y%# ª z n � � W ª � �[� �"� v # W � � ªa©\ª*n � �r� � � W ª y%# ª z n � � W ª �[�[� �r� � z W �:� # ©(n � �r� � � W ª y # ª z n � � W ª � ��� �r� vJv1v W y � � # ©5n � �

{ )?2143<E6 # W ©(u��i<L+-[39�<E6"[3<E6�7=6"%\@E+-@=)?H1%�H1B�+#B f&7�@E<=45Rk@=4(<=6

$l@Y),7Y7=)OZ/[3>?6^)?%U@=9(6K7N6�%(7=6@=9(+-@Y6�+JRL9U+a@N@E<=)?`34*@E6���H1<QBD68+a@=4(<=6;�G9(+17S+-%�+-@=H1Z/),R:a+->?436�@E9(+a@ )}@�R"+-%^@E+-�J6�H14*@ H-B(+GT(VP68'iT(%3)O@=6G7N6"@�Wm$lB3FI6p<E6">,+aVC+a@EH1Z/)?R")}@�AJn8@=936I:;+1>O4(6H-Bi+-%�+-@N@E<=)?`34*@E6�R�+-%�`e6U+�BD68+a@E43<=6�7N@=<E4(Rk@E43<=6�+-%5'�F 6�R"+1% `34()O>,' 9()O6�<E+1<ERL93),R"+1>7N@=<E4(Rk@E43<=687"Ww�P43[3[eHJ7=6�F 6�FI6�<=6b@=Hs21<EH14([�%P43Z +-%5'�[e6"<L7NHJ% )?%J@EH~HJ%36�BD6�+a@E43<E6R"+1>O>?6�'U+121<E6"6�Z�6�%\@�n*@E936"%U)O@E7Y:;+1>O4(6^FIHJ43>,'�`56^%(H1%*f&+a@EH1Z/)?R_� �P6"6#{m)?214(<=6 # W � �kWG$&%B f&7�@E<=4(Rr@=43<E6�7G)?%U.0{���n*FI69(+;:J6S`e6"6�%�4(7N)?%32_7=4(RL9URrH1Z/[3>?6rVd7�@E<=4(Rr@=43<E6�7�W{368+a@E43<=6G7N@=<E4(Rk@E43<=687mR�+-%/7N)?Z/[3>?A`56G:P)O6�FI68'K+J7 R"H1Z/[3>?6rVK7=APZK`eH1>,7mHJ<�RrH1Z/[3>?6rVR"+-@=6�21H1<E)?6�7�W �C� � � `PA �C+ ��'3+1< 6"@Y+-> W]� v ª # � �pFQ9()?RL9d4(7=6�7 BD6�+-@=43<E6�7G6"VP@=6"%57N)?:16�>OAJn)?%�B�+JRk@8n(R"+1%d`e6^7=93HaFQ%d@=H/`56K6�c\43)?:;+1>O6�%\@Q@=H_+ � {�� `PA�@=9()?7^��+-%('dH1@=936�<L�G+1<=2J4*fZ/6"%\@8��7E�rW XmHY)?>?>O4(7N@=<L+a@E6p@E936I+1<=2J43Z/6"%\@�na7=43[3[eHJ7=6tF 6tFG+-%\@�@=Hi7=+;AJn;4(7N)?%32YBD6�+a@E43<E6�7�n@=95+a@Y7=43`�(�6�Rr@]ZK4(7N@]+-2J<=6�6SFQ)O@=9d@=9(6:16"<E`d)O%�%P43ZK`e6"<8u� � �Y� �S�� 7N4(`�( ��� � 7N4(`�( %P43Z ��� %P43Z� ���

�P43[([5H\7N6tBD43<N@E936"<0@=9(+-@m%P43Z R"+1%C@E+1�16pHJ%36tH1B\@�F H]:a+->?43687078�D)?%32143>,+-<k��+1%('[3>l�D43<L+-> �kW�]HaF %P43ZK`e6"<h+-2J<=6�6"Z/6"%\@�R"+1% `56�6"V*[3<=687=7=6�'�FQ)O@=93HJ4*@�BD68+a@=4(<=687�`PA 7=43)O@E+-`(>OA+1'('*)O%(2�%(6"F R"+a@E6"2JH1<E)O687I+1%('d<=43>?6�7�u� � �Y�pf&� �S�pf&� � �S��f&�t. �S��f&�t.FQ936�<=6 �Y�pf&��7N@E+-%5'37GBDH1<]7=)?%32143>,+-<G%3HJ43%d[393<L+17=6i6"@ER1W

Page 141: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

����� ��� � � � !�E��P$]��%��� � �,����� � v8z ª

7=)O%32J43>,+-<� v �PW z ��y ª y n � � W ª � �[� �"� v �PW z �!y ª y n � �

%P43Z

y� z W � n � � W ª � � � �r� z W � n � �

[e6"<L7NHJ%� y�y W ª1ª �!y n � � W ª � � � �r� v �*W z �;y ª y n � �r� y�y W ª1ª ��y n � � W ª �[� � �r� � � W © #�� � n � �

+-2J<=6�6"Z/6"%\@

`eHaA�$�PW ª v � � ª(n � � W ª � � � �"� �PW ª v � � ª3n � �

[3<=6�'

+ � z W � n � � W ª � � � �r� z W � n � �

7=[568R� � z W # � ª+�;©5n � � W ª � �[� �"� y�y W ª-ª �;y(v n � �r�$� z W #[� ª �;©(n � � W ª �[�[� �r� v � ©5W y[�[��� � n � �r� � z W # � ª �8©(n � � W ª � �[� �"� v © y W z*v ª1© # n � �

������� �&�� � � � � � � � � � � � � ()����� ��� � � y ������� � � �

��� � �*,++++-

{ )O2J43<E6 # W � u��i<E+1[39d+1%('dZ_+a@=<E)OVb%3H-@L+a@E)OHJ%bBDHJ<]+�R"H1Z/[3>?6rV�BD68+a@E43<=6^7N@=<E4(Rr@=43<E6

Page 142: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v,y � ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

��<�� <>= � D�� � GPQ�D � {368+a@E43<=6C7N@=<E4(Rk@E43<=687tHJ<QRrH1Z/[3>?6rVbR�+a@E6"21HJ<=)?6�7pBDH1<EZ +K>,+a@=@=),Rr6i`(+17=6�'bH1%d7N43`57N43Z/[*f@=)?H1%U+1>?7=H�R�+->?>O68'b6"VP@=6"%57N)?H1% �D%(H-@E+-@=68'�+J7��Y�kW�$l@YR"+1%�`e6^'*6"T(%36�'�+J7 BDH1>?>OHaF]7�u� ������������� � � Wy)O�� +17=6_�D) � $lB � +1%(' W +-<E6+a@EH1Z/)?Ri:a+->?43687"nP@E936"% � �

W� +17=6b��)O) �]$lB � +-%5' W +1<=6^BD6�+a@E43<E6#7N@=<E4(Rk@E43<=687"n5@=9(6"%�)OBp@=9(6"<E6K),7S+_[5+-)?<#��+(n 4e�])?%� n3@=936�<=6C),7]+�[(+-)?<^��+(n :3� )?% W 7N4(RL9�@=95+a@]4�� :�W{3HJ<�6":16�<=A+-@N@=<E)?`34*@=6G:a+->?436Jna@=936Q`eH-@=@=HJZ 6">?6"Z/6"%\@�H-B5@=936G>,+a@=@=),Rr6G)?7 @E936G6"Z/[*@�ABD6�+-@=43<E6G7�@E<=4(Rr@=43<E6G+-%('^@=936 @=HJ[K6�>O6�Z�6�%\@�X ),7�+-%�+-<=@=)OT5Rr),+->?>?Ai)?%\@=<EH*'*4(Rr68'^6�>O6�Z�6�%\@BDH1<SFQ93),RL9 ��� X�BDHJ<i+1>O> �KW��P43`(7=43Z/[*@E)OHJ%�),7Y+�[5+-<=@=),+->0HJ<E'36"<YFQ9()?RL9�ne<EH1432J93>OA7=[568+-�P)O%(2(n\6rV*[3<E6�7E7N687pFQ936"@=936�<I@�F H#7N@=<E4(Rr@=43<E6�7 +-<E6YRrHJ%(7=)?7N@=6�%J@G+-%('bFQ936r@E936"< H1%(6RrHJ%\@E+-)?%(7GZ/H1<E6C7N[e6�R")}T5RC)?%*BDHJ<=Z_+a@E)OHJ%b@E9(+-%d@E936H-@E936"<8WXGF H^BD6�+-@=43<E6C7�@E<=4(Rr@=43<E6�7 {�� v +-%('�{�� z +1<=6 � ���*��� ��� � � �e)O�U@=936�<=6i)?7G+^BD6�+a@E43<E67N@=<E4(Rk@E43<=6{��h�DH1@=936�<G@=9(+1%�X]�G7=4(RL9�@=9(+-@Y{�����{�� v +-%('d{�����{�� z W� � � �� �(��� � �UH1BG{�� v +1%('s{�� z )?7@=936�>?6�+J7�@43[([56�<K`eH143%('hH1BG{�� v +1%('s{�� zHa:16�<0@E936]7=43`(7=43Z/[*@=)?H1%�>?+-@N@E)?R"61WQ� �Y%3)}TeR"+a@E)OHJ%#),7�7E+-),'^@EHC7=4(R�Rr6"68'K)OBe+i>?6�+J7�@�43[3[e6"<`eH143%('s��H-@=9(6"<G@=95+-%UX]� 6rV*),7�@L7"W��XG936G%3H1@=)?H1%KH1B543%()}T5R�+a@E)OHJ%�n-FQ93)?>O6Q)O@�9(+17�`e6"6�%#`eH1<E<EHaFI68'CBD<=HJZ >?H121),R-na),7�Z/H1<E6216�%36"<L+->�936�<=6JW � @E6"<EZ|)?%~>?H12J)?R�9(+J7YT(VP68'h%\4(ZK`e6"<H-BG+-<E2143Z/6�%J@L7"n�FQ9(6"<E6�+17i)?%BD6�+-@=43<E6^2J<E+1[39(7Q@E936K%P43Z#`56�<SH1B�BD6�+a@E43<E6�7S)?7YH1[e6"%�Wi{3H1<S6rV3+-Z/[3>?61ne)?%��p<EH1>?H12/F 6Z_+;A�6rV*[3<E6�7E7I@=936 �S��) +�`eHaA +PBD<=HJZj{ )O2J43<=6 # W y �D`5�G+J7"u�>� � |!�,� � { ��� � �>� �!z>{,�%�

q]6�<=6Jn�@=936�+-<E214(Z�6�%\@E7�RrH1<E<E6�7=[5HJ%('h@=H~[3<=68'�nt7=[568Rb+1%('�%P43Z�np<E6�7=[568Rk@E)O:J6">?A1Wh$l@R"+1%U`56#H1`*@L+-)?%36�'�`PA�43%3)OT5R�+a@=)?H1%�BD<EH1Z @=9(6^BDH1>?>?HaFQ)O%32�@�FIH_@E6"<EZ_7QBDH1<') `eHaA +5+1%(')�+,+3RrHJ<=<E6�7=[eH1%('*)?%32#@=H_{ )O2J43<E6 # W y ��+\�ku

�>� � |!�,� � �7�>� ��� � ��� �!z7{,� ��>� � �>�>� � { � �>�>� �

$lBYF 6b%3HaF�FG+-%\@=68's@=Hh+1'3'�7NHJZ/6b+1'3'3)}@E)OHJ%(+-> )O%3BDH1<EZ/+-@=)?H1%�FQ)O@=9 @=936b@=6�<=Z BDHJ<) `5HaA +�7E+;A1n0+1`5HJ4*@936")?219\@�nm)}@^),7C%3H1@C68+17=A�+17RL95+-%32J6�7i9(+;:16#@=H�`e6_Z_+1'*6�BDH1<^+1>O>�P)O%5'37QH-B H-@E936"<Q%3[d@E6"<EZ/7�W� 7 HJ[3[5H\7N68'C@=HC+-`eHa:16Jna)}@�),7 +S<E6">,+a@=)?:16�>OACZ/)?%3H1<�Z_+a@=@=6"<�)?%^BD68+a@=4(<=6G7�@E<=45Rk@=4(<=687@=H�+J'3'h+�%36"F BD6�+a@E43<E61W � `(7N6�%(Rr6/H1BG+�BD6�+-@=43<E6_)?%s+�BD68+a@=4(<=6�7N@=<E4(Rk@E43<E6/7=)?Z�[(>OAZ/6�+1%(7S@=9(+-@S@E936�7N@=<E4(Rr@=43<E6�'3H\687i%3H-@C<=687�@E<=),Rk@S@=936�:a+->?436�H-Bp@E936�BD6�+a@E43<E6#)?%~+1%\AFG+;A1W $l@ R"+1%�`e6S7E+-),'/@=9(+-@t@E936YBD68+a@E43<=6S7�@E<=4(Rr@=43<E6�7 +17E7=43Z/6Y+-%�HJ[56�%�F H1<E>?'/FQ93)?>?6@=9(6C@=6"<EZ_7Q+17E7N4(Z�6+/Rr>?HJ7=6�'�F H1<E>?'�WXG9P4(7�nQBD6�+-@=43<E6~7N@=<E4(Rk@E43<E6�7b+1%(' @E936")?<�4(%3)}TeR"+a@E)OHJ% 21)?:1687 \(6"V*)O`3)?>?)}@�A @EH�@=9(6>?)O%32J43),7�@L7I)?%�@E9(+a@G@E936"A�'*H�%3H1@ 9(+;:J6]@EH�7=[568Rr)OBDA�)?%�+1'3:;+1%(Rr6i93HaFyZ_+-%PA/BD68+a@=4(<=687R"+1%d7=93HaF 43[U+-%('�)O%�FQ9(+-@]H1<L'*6"< @E936"Ad7N93HJ43>,'�+1[3[568+-<8W$&%�43%()}T5R�+a@E)OHJ% 21<L+-Z/Z_+-<KH-B "+;A � v ª+�aª\�kn�.0{���n��C�I� � 6"@ER1W~@E936�R"H1%\@=6"VP@BD<E6"6U<E43>O687_7N[e6�R")}BDA�93HaF @E936�RrHJ%(7N@=)O@=436�%J@L7�+-<E6d@=Hs`e6�`343)?>}@�4([�nQ+-%('�@=9(6�RrH1%3f7N@=<L+-)?%J@L7QH1%dBD68+a@=4(<=687Q)O%5'*)?R�+a@E6^<=687�@E<=),Rk@E)OHJ%(7G@E9(+a@Y9(H1>,'d+JRr<EHJ7E7QRrHJ%(7�@E)}@E436"%\@L7K�D`e6rf@�F 6"6"%d'3+-4(219\@=6�<I%3H*'*687GH1< `56"@�FI6�6"%dZ/H-@=9(6"<Q+-%('�'3+-4(219\@=6�<I%3H*'*687E�rW�$&%*BDH1<EZ_+->?>OA

Page 143: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

����� ��� � � � !�E��P$]��%��� � �,����� � v,y(v7=[568+-�P)O%(2(n1R"H1%(7N@=<L+-)?%\@E7�[3<EHa:P)?'*6 @E936][eHJ7E7N)?`3)?>O)O@�A^@EHC@=<L+-%(7=[5HJ<N@�)?%*BDH1<EZ_+a@E)OHJ%�+1>OHJ%32@=9(6�`(<E+1%(RL936�7SH-B +�7=AP%J@L+1Rr@=),R^@E<=6�61Wb��$lBIF 6#2J6r@<=),'�H1Bp@=9(6/R"H1%(7N@=<L+-)?%\@E7i+-%('�6"%*fRrH*'*6b@=936�Z )O%\@EHhR"H1Z/[3>?6rV�R"+-@=6"2JH1<E)O687)?%�RrHJ%\@=6rVP@#BD<=6�6b<E43>O687"n�@E936d)O%*BDHJ<=Z_+-@=)?H1%@=<L+-%57N[eH1<=@]+1Rr<EHJ7E7GR"+-@=6"2JH1<E)O687 )?7 �ERrHJZ�[()O>?6�' ��`PAb)?%(R"<=68+17=)O%32#@=9(6^%P43ZK`e6"<]H1B�R�+a@=f6"2JH1<E)O687"W��$lB5F 6]RrHJZ/[(+-<E6IFQ)O@=9_+-@N@=<E)?`34*@=6G2J<E+1Z�Z_+1<E7 F 6IT5%('#@=9(+-@�)?%�@=93H\7N6G2J<E+1Z�Z_+1<E7�n7=A\%\@E936�7=)���6�' BD6�+a@E43<E6�7�[56�<ER"H1>,+a@=6~BD<EH1Z `5H1@N@EH1Z @EH @EH1[ H1B^@=9(6~@E<=6�61nSFQ936"<E6�+J7)?%3936"<E)O@=6�'U+-@N@E<=)?`34*@E6�7 \5HaF '3HaFQ%�@E936^@E<=6�61W �]%()}T5R�+a@E)OHJ%�n5HJ%�@=936KH-@=9(6"<Y95+-%('�n5)?7H1<L'*6�<�BD<=6�61W�XG936]7E+-Z/6Q<=687N4(>}@t),7�HJ`*@E+1)O%368'/)O<E<E6�7=[568Rk@=)?:16GH1Be@EH1[*f&'*HaFQ%�H1<p`eH-@=@=HJZ#f43[d[3<EHPR"6�7E7N)?%325W � BmR"H143<L7=61n*RrHJZ�[(>O6"@=6"%(6�7E7 +1%('bR"H1936�<=6�%(Rr6iR"+1%bH1%(>OA_`e6RL936�RL�J6�'+a@G@E9366"%('�+-B @=6"<]@=936CT(%5+->�B f&7�@E<=4(Rr@=43<E6C)?7]H1`*@L+-)?%36�'�W

�]%()}T5R�+a@E)OHJ%�Ha:J6"< BD6�+-@=43<E6^7�@E<=45Rk@=4(<=687G9(+17 @E936^+1'*:a+1%J@L+-2J6Y@E9(+a@])O@]21)?:1687QRrH1%3f7=)?'*6�<E+1`3>?6mBD<E6"68'*H1Z @=HQ@E936�>?)O%32J43),7�@0)?%7N[e6�R")}BDAP)?%32]<E6�7N@=<E)?Rr@=)?H1%(7�+JRr<EHJ7E7�RrH1%57�@E)}@E436"%\@E7�W$l@I+1>?7=H21)?:1687 BD<=6�6�'*HJZ @=H^@=936])?Z/[3>?6"Z/6"%\@=HJ<�@=HK[56�<NBDHJ<=Z @=936YRL9(6�RL�*7p+a@pFQ95+a@=6�:16�<7N@E+-2J6I)?%/FQ9(+a@E6":J6"< H1<L'*6"<�936GFQ),7N93687"W�W 4*@�@=936�<=6G),7�+i[3<=),Rr6 @EHi`e6G[(+-),'�W $l@p<=687N4(>}@L7)?%�+1%�)?%36"�_R")O6�%\@]H1[e6"<L+a@=)?H1%�BDH1<G@�F H�<=68+17=H1%(7�uv W �]HKHJ<E'36"<p),7t)?Z/[3>?)O68'�n3+-%('/`e6�R�+-4(7=6]@E936"<E6Y),7I%3HKFG+;AK@EH#+J7=7=6"<=@p@=95+a@ 7=H1Z/6"f@=93)?%32(na7E+;A1na7=H1Z/6p)?Z�[eH1<=@E+1%\@0BD6�+-@=43<E6I7=93HJ43>?'^`56 RL936�RL�J6�'iT(<L7�@8na)}@ <=687N4(>}@L70)?%)O%36"��Rr)?6"%(R")O687"WI�P@=<E4(Rk@E43<=687]+-<E6C`343)?>}@i+-%('dH1%(>OA�ZK4(RL9�>,+a@=6�<]+-%�)?Z�[eH1<=@E+1%\@BD6�+a@E43<E6iZ_+;AbR�+-4(7=6iB�+-)?>O4(<=6+-%5'b43%5'*H1)?%32/H-B�FIHJ<=��Wz W�WI68R"+14(7N6#H-Bp@E936"\(6rV*)?`3)?>O)O@�AU)}@[3<EHa:P)?'36�7�ne4(%3)}TeR"+a@E)OHJ%�),7C+-%�6"V*[56�%(7N)?:16�H1[3f6"<L+a@=)?H1%0W

��<�� <�� � Q,N�� B M � R Q�B,GTD Q,R.0{���+->,7NHb[56�<=Z/)O@E7S6rV*)?7N@=6�%\@=),+->mR"H1%(7N@=<L+-)?%\@E7�WQ$l@S),7Y457N68'�@=H�6"V*[3<=687=7]@=9(+-@i+1%�+a@=f@=<E)?`34*@=6Z#4(7N@]9(+;:16C+�:;+1>O4(6FQ)}@E93H14*@Y7=[e6�Rr)OBDAP)O%(2#@E936:a+->?4361Wp{(H1<Q6"V*+1Z/[3>O6Jn� � @E6"%(7=68�),7�+-%C6rV*),7�@E6"%\@=),+->JRrH1%57�@E<E+1)O%\@�)O%C@E936 � {b<=43>?63U � BDHJ<�A1687�fl%3HQc\436�7N@=)?H1%(7�u � U � �Q� � � �S� �� +14*V � � � � 7=43`�( ��� � � �$l@ +J7=7=6"<=@E7�@=9(+-@t@=9(6S+a@=@=<E)O`(4*@=6Y@=6"%57N6SZK4(7N@I9(+;:J6]+:a+->?436Y)?% �i��W\XG93),7tR"H1%(7N@=<L+-)?%\@R"+1%�HJ%3>?A�`56^RL9(6�RL�168'�+-@G@=9366�%('�+aB @=6�<G@=936CB f&7N@=<E4(Rk@E43<=6C9(+J7G`56�6"%U`34()O>O@�W� %(6"2J+-@=)?:16^6"V*)?7N@=6�%J@E)?+1> R"H1%(7N@=<L+-)?%\@Y),7S+1>?7=Hb+;:a+-)?>?+1`3>?61neFQ93)?RL9�)O%�R"H1%\@=<L+17N@]@EH+-`eHa:16Jn*+17E7N6�<N@L7t@E9(+a@Q@E936%(+1Z�68'�+a@N@E<=)?`34*@E6ZK4(7N@Q%3H-@]`e6[3<E6�7=6"%\@�W{ )O%5+->?>OAJn�@=9(6"<E6�),7+-%(H-@=9(6"<C@�AP[56_H1BGR"H1%(7N@=<L+-)?%\@S@E9(+a@^6"V*[3<=687=7=6�7i%368Rr687=7=)}@�A�H-B6rV*),7�@E6"%(R"6CH-B�+#[5+-<=@=),Rr43>,+-<G:a+->?4361Wp{(H1<Q6"V*+1Z/[3>O6Jn� +-4*V � � �)?%�<=4(>O6 U � n�6rV*[3<E6�7E7=6�7@E936b%(6�Rr687=7=)O@�A�@E9(+a@#@=936d+a@N@E<=)?`34*@E6d+14*VsZK4(7N@#9(+;:J6_@=9(6:a+->?436 ) � +?W �]%3>?)?�16h43%3)OT5R"+-@=)?H1% �DBDH1<�%3HJ<=Z_+->i6�c\4(+1>O)O@�A3�/@E93)?7UR"H1%(7N@=<L+-)?%\@bH1%(>OARL9368RL�P7m@E936G:;+1>O4(61n1)O@p'*HP6�7�%3H1@p+1'3'#)}@�@EHS@E936GB f07N@=<E4(Rk@E43<=6 )OBe%3H1@p+->?<=68+1'*A[3<E6�7=6"%\@8W

Page 144: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v,y\z ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

XG936i[343<E[5H\7N6iH-B0@=93),7Q'*6":P),Rr6i)?7 @EH�+;:JH1),'_[34*@=@=)?%32_'*6rB�+143>O@ :a+->?436CH-B +-%�+-@N@E<=)?`34*@E66":J6"<EAPFQ936"<E6FQ936"%�@=936#%3H1%3fl'*6"B�+-43>O@C:;+1>O4(6K),7Y%36�6�'*68'UH1%(>OAU+a@C+_BD6�F [3>,+1Rr687"WS$&%@=9(6�6"V3+-Z/[3>?6/+1`5Ha:J61n�)OB F 6�'3)?'~%3H-@9(+;:J6K@E936/%36�R"6�7E7N)O@�A�RrHJ%(7N@=<L+-)?%J@8n�FI6/F H143>,'9(+;:J6@=Hb7E+;AdFQ)}@E9�6":J6"<EAb%3HJ%*fl+14*V*)O>?),+-<EAb:16�<=`0n3@=95+a@Y@E936K:a+1>O436#H-Bt+-@N@=<E)?`34*@=6�+-4*V),7") f +OW �YHaFn�@=95+a@^),7%3H-@%368Rr687=7E+-<EA�M0FQ936�%~%3H1@=93)?%32U),77�@L+a@E6�'s+-`eH14*@^+14*V�n�@=9(6'*6"B�+-43>O@t:a+->?436Q),7�) f +?W $l@ 7N93HJ43>,'#`e6]%3H1@=68'K@E9(+a@I)}B�BDH1<p+1%�+a@=@=<E)O`343@=6QH1%(>OAK@=93),7p�P)?%('H-B�RrHJ%(7N@=<L+-)?%J@G),7G4(7N68'�n3)O@]Ha:16�<=<E)?'36�7t@=936HJ[56�%dF H1<E>,'b+17E7=43Z/[*@=)?H1%�W� �� ���#�����"�98�!r���98$&%�@=93),7QRL9(+-[3@=6"<8nPFI6C9(+;:J6]@E<=)?6�'b@=H_7=93HaF @=9(+-@].0{�� )?7Q+�7N@=<EH1%32/RrHJZ�[(4*@E+-@=)?H1%(+1>BDH1<EZ_+->?)?7=Z BDHJ<tHJ`*@E+1)O%3)?%322J<E+1Z�Z_+-@=),R"+->*<E6">,+a@E)OHJ%(7�BD<EH1Z�+7N6�%\@=6"%5Rr61W�$l@t95+17p`e6"6�%6�7=[e6�Rr),+->?>?AK'*6�7=)?21%368'KBDHJ<p+C[5H\7N)O@=)?H1%5+->*>,+-%32J4(+-2J6 7=4(RL9_+17�ot%321>?)?7=9�FQ93)?RL9/4(7=6�7�[eH-f7=)}@E)OHJ%(7pHJ<pFIHJ<E'�HJ<E'*6�<�@=H#6"%(R"H*'*6Q@=9(6r@E+^<=6�>?+-@=)?H1%(7p+J7pF 6">?>5+J7�@=HJ[3),R"+->?)���+a@E)OHJ%�W#W A4(7=)O%(2Y21<L+-Z/Z_+a@E)?R�+->-<E6">,+a@E)OHJ%(7p��)O%KB fl7N@=<E4(Rk@E43<E68�kn;)O@ ),70+1`3>?6p@=HS6rVP@=<L+1Rr@m+-[([3<=HJ[3<E)?+-@=6)?%*BDH1<EZ_+a@=)?H1%�BD<EH1Zj+1%dot%321>?)?7=9�7N6�%J@E6"%(R"61W

� JB�Q,N�� B H�� G��D��

W <=687N%5+-%�� v ª #\z ��R"H1%\@E+1)O%57m7=6":J6"<L+->1[5+-[e6"<L70HJ%K.0{��wBD<=HJZ @=936 >?)O%32J43),7�@E)?RI:P)O6�FGf[eH1)?%J@8W�"+-[3>,+-%/+-%(' W <E6�7=%(+-%�� v ª #Jz �m)O%\@=<EH*'*4(R"6�7�@E936QBDH1<EZ_+->3.m{�� 7NA*7N@=6"Z�WTX�+-f@=6�<=),+-> )?% @E93)?7/RL9(+1[*@=6�<KT5<E7N@/+1[3[e6�+-<E6�' +17#[(+-<=@#H1BS+�@E4*@=HJ<=),+->C� W 9(+1<E+-@=) 6r@_+-> WOnv ªJª z `5�kWQ�P6"6VU]+-Z/6�7=9U+-%('��3+-%32\+->t� v ª # ªJ�rnEW >OH*RL��+1%('UqY+143216�%36�'36"<K� v ª #%# �IBDHJ<+/'*),7=R"4(7=7=)?H1%dH1%d)OZ/[3>?6"Z/6"%\@L+a@=)?H1%U+J7N[e6�Rr@E7GH-B�.0{���W�i6"%(6"<L+->?)���6�'i�p93<L+17=6p�\@=<E4(Rk@E43<E6 �i<E+1Z�Z_+1<p� �C�I�����Z/6"%\@=)?H1%368'i)O%C@E93)?7mRL9(+-[3f@=6�<^),7K+-%(H-@=9(6"<F 6">?>t�P%3HaFQ%h21<L+-Z/Z_+-<CBDH1<EZ_+->?)?7=Z [(<=HJ[5H\7N68'�`PA��C+ ��'3+1<^6r@K+1>�W� v ª # � �kWd.0+-@=6">?A1n q]68+1'Pf&'*<E)O:J6"% �p93<L+17=6��\@=<E4(Rr@=43<E6 �i<E+1Z/Z/+1<b��qS�I� ��9(+17`e6rfRrHJZ/6d[eH1[(43>?+1<_)O% op4(<=HJ[56 ����HJ>O>,+-<L'�6"@�+-> W � v ª # � �rnS� v ª # �-�rn �IH1[e6">,+-%5' 6"@_+1>�W� v ª1ª v �N�rW

�� � B�� D@R�� R

� ��� �P93HaF @=936^Rrfl7N@=<E4(Rr@=43<E6+-%('bB fl7N@=<E4(Rr@=43<E6CBDH1<G@E936CBDH1>?>OHaFQ)?%32/7N6�%\@=6"%5Rr6�7��+J� XG936CB�+1<=Z/6"<]7E+;F +�`3)?2/T(<E6"`(+1>O>�)?%d@=936^7=�PA1W��`5�GXG936`eHaA�F 6"%\@G@=H�@=936^7ERL93HPH1> W��R��GXG936RL93)?>,'dR">O)?ZK`e6�'�+#@=<E6"6JW��'(��ZS)O:J6"<L7Q7N68+-<LRL936�'�@=936H*Rr68+-%d`568'�BDH1<Q[e6�+-<E>,7"W� �����+\�Q�P93HaF >O6"VP),R"+1>�6"%\@=<E)?6�7 BDH1< ) F 6"%\@ +3+1%(' ) 7=6�+1<ERL9368' +\@=H/9(+1%('*>?6C@=936^+1`5Ha:J61W�D`e�GX0H_9(+1%('*>?6i@=936CBDHJ>O>?HaFQ)O%(2/7=6"%\@E6"%(R"6�7Q+17GF 6">?> n*FQ9(+a@]FQ)?>O>�AJH14d9(+;:16i@EH/'3H��

Page 145: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

����� ��� ��%V���!�� $]��% � v,y�y��),�GXG9(6i`eHaAbF 6"%\@Q93HJZ�6JW��)O) ��ZS)O:J6"<L7Q7N68+-<LRL936�'�BDH1<Q[e6�+-<E>,7GH1%�@=936H*Rr68+-%d`568'�W� ��� �IH1%57N),'*6"<G@E936CBDH1>?>?HaFQ)O%32/7=6"%\@=6�%(Rr687"u��+J�Igh6F +1%J@]R�+-�1687"W��`5� � � +1�1687 +1<=6iFG+-%\@=68'b`PAb457"W��R��G��HJ>O),Rr6iF +1%\@E7GA1HJ4�W��'(� �pH14U+1<=6iF +1%\@=6�'�`PA_@=9(6[5HJ>O),Rr6JW�\@L+a@=6bFQ9(+a@#7=[e6�Rr),+->I[3<EH1[3<E6r@E)O687H-B].0{�� 21<L+-Z/Z_+-<^R"+1%sZ/+1�16���+J�rn?��R��+1%('y��'(�+1R�Rr6�[*@E+1`3>O6CFQ936�<=68+17C�D`e�G)?7G<E6&(�68Rk@E6�'�W� � ���+\�Q�P93HaF @=936^Rrfl7N@=<E4(Rk@E43<E6i+1%('�B fl7N@=<E4(Rk@E43<E6SBDHJ<�u

XG9367N68Rr<E6r@E+1<=A_[e6"<L7=4(+1'*68'�@E936`eHJ7E7 @=H_21)?:16i936�<]+/>OHJ%32/>O68+;:161W�D`e�_�P93HaF @E936U>?6rV*)?R�+->Q6�%J@E<=A�BDH1<9) [56�<E7=4(+1'36[+p7=H~@E9(+a@_@E936U)?Z�[(>O),Rr)O@b7N4(`�(�6�Rr@�H-B) 21)?:16[+*),7G),'*6"%\@=)OT(68'�W��R8�mgy9(+a@�),7 @=936Q'*)O�e6�<=6�%(Rr6 `e6r@�F 6"6"%�>?6rV*)?R�+->P6"%\@E<=ACBDHJ< ) [3<EH1Z/),7N6 +;+1%('*) [e6"<L7N45+1'*6 +� ��! XG936#BDH1>?>OHaFQ)?%32b7=6"%\@E6"%(R"6�7Y+1<=6K43%321<L+-Z/Z_+a@E)?R�+-> WYq]HaF '3H\687S.m{���+JR"RrHJ43%\@BDH1<Q4(%321<L+-Z/Z_+a@E)O>?)}@�Ab)O%�6�+JRL9�R�+17=61W��+J��U]+1Zj[3<EH1Z/),7N68'd�P)O@E+�2JH(W��`5��U]+1Z [3<EH1Z/)?7=6�'�W��R���U]+1Z [3<EH1Z/),7N68'�@E9(+a@S�P)O@E+�@EH/21H(W� ��� gh<=)O@=6^.m{�� 21<L+-Z/Z_+-<I@=H_9(+1%('*>?6S@E936CBDH1>?>?HaFQ)O%32/�P)?%('37GH-B�7=6"%\@=6�%(Rr687"u��+J� � 6rV*[e6�Rr@=6�'�@EH_21H(W��`5� � 6rV*[e6�Rr@=6�'9W @EH_21H5W� >,7=H�7=93HaF @=936h>?6rV*)?R"H1%y6�%J@E<=AwBDHJ< ) 6rV*[e6�Rk@ +OW ��gy93)O>?6hFQ<=)O@=)?%32 2J<E+1Z/Z/+1<bAJH147=93H143>,'��16�6"[U)?%UZ/)O%('�H-@=9(6"<Y7=6"%\@=6�%(Rr6^@�A\[e6�7Y)O%�ot%321>?),7N9UHJ<Y7N)?Z/[3>?A�`e6"2J)O%�BD<EH1Z@=9(6^21<L+-Z/Z_+-<Q2J)O:J6"%�)O%�@=936KRL95+-[*@E6"<Y+1%('�Z/HP'3)}BDAd)}@Y@=H�9(+1%('*>?6@=9(6K+-`eHa:16C@�AP[e6H-B�7=6"%\@=6�%(Rr687"W��� ��� �P93HaF @E936SRrfl7N@=<E4(Rr@=43<E6]+-%('_B fl7N@=<E4(Rk@E43<E6QBDH1<t@=936YBDH1>?>OHaFQ)?%32K7=6"%\@=6�%(Rr687"W � >,7=HZ_+-<E�_@=9(6%3H*'*6�7G)?%URkf&7�@E<=4(Rr@=43<E6CFQ936"<E6RrHJ%J@E<=HJ>O>?6"<G+-%5'dR"H1%\@=<EH1>?>?6"6iHPR�Rr43<8W��+J� � `e6">?)O6�:16�'�@E9(+a@WyF H1%5'*6"<E6�'�FQ9(+a@]'*),'�@=9362J)O<E>�21)?:16i@EH#@E936`(+1`\AJW

Page 146: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v,y © ��������� ��,���#���$]����� ��!#%V� P$]��%���K� �� � � ��

��`5�IXG936S2J)O<E>eFIHJ%('*6"<E6�'�FQ93HVU]+1Z `56�>O)?6":J6�'d�P)}@L+#R">?+1)OZ/68'/@=9(+-@G@=936i`(+-`PA_7E+;FW� ��� � %5+->?A ��6h@=936hBDH1>?>?HaFQ)O%32 7=6"%\@=6�%(Rr687d+1%('�7N93HaF|@=936�)O<�Rrfl7N@=<E4(Rk@E43<E6h+1%(' B f7N@=<E4(Rk@E43<=6JW�gy9(+a@]),7G@=9(6Z�H*'*)OT(68'�2J<E+1Z/Z/+1<t@E9(+a@]),7Q%36�6�'*68'�W��+J�Igy93H�'*),'9U]+-Zj21)?:16+�`5HPH1��@=H��

��`5�GXmH�FQ9(H1Z '3)?'9U]+1Z 21)?:16+�`5HPHJ� �

��R��GXG936C2J)O<E>�FIHJ%('*6�<=68'bFQ93H/$ `56�>O)?6":J6�'b@=9(+-@Q@=936`5+-`PAb7E+;F��

��'(�GXG9362J)O<E>�FIHJ%('*6"<E6�'�FQ93H�@=9(6`(+-`PA�[e6"<L7N45+1'*68'�@E936`5HaA�@=H�7=6"61W� ��� q]HaF FQ)O>?>�AJH14d9(+-%('3>O6C@E936CBDH1>?>OHaFQ)?%32/7N6�%\@=6"%5Rr6�7�u��+J� XG9362\+-<L'*6"%36�<G`56�>O)?6":J6�7 @=95+a@Q@=9(6`5HaA*7G[3>?4(RL�168'�@E936CBD<E43)}@L7"W��`5� $l@]),7G`56�>O)?6":J6�'�@=9(+-@Q@=936`eHaA*7G[3>?4(RL�168'�@E936CBD<=4()}@L7"W��R��bXG936�`eHaA*7b+-<E6�`e6">?)O6�:168' @=H�95+;:16�[3>?4(RL�J6�'w@=9(6�BD<E43)O@E7�Wj�D$&2J%3H1<E6 �N95+;:16 �(W� 7E7N43Z/6i@=95+a@Q@=9(6^7N6�%J@E6"%(R"6C)?7 � " FQ)}@E93H143@])}@8W �W 43)?>?'�@=9(6%36�R"6�7E7=+1<=A_2J<E+1Z�Z_+1<I<E43>?6�7Q+-%5'�>?6rV*),R"+1>�6"%\@=<E)O687"W

Page 147: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� �

� � � � � � � � � � � ��� � � � �

� 2J<E+1Z/Z/+1<)O%�.m{��jBDH1<EZ_+->?)?7=Z 9(+17C@�F H�`(+J7N),R_RrHJZ/[5HJ%36"%\@E7�u/+-% 43%('36"<E>OAP)?%32RrHJ%\@=6rVP@IBD<=6�6Y21<L+-Z/Z_+-< +-%('_@=936C+17E7NH*R")?+-@=6�'_BD43%(Rk@E)OHJ%(+->�7=[568Rr)OT5R"+-@=)?H1%�W�$lB0F 6]@E<=A@=Hh4(7=6d.m{�� BDH1<EZ/+1>O),7=Z @EH~FQ<E)O@=6�+�2J<E+1Z�Z_+1<KBDHJ<#$&%('3)?+1%�>,+-%32J4(+-2J6�7��DH1<_+1%\ABD<E6"6rflF H1<L'�HJ<E'*6�<>?+1%32145+-21687E�rn�@=9(6�[3<EH1`3>?6"Z_7C`e6"21)?% FQ)O@=9 � {�� +-%5'~2JH�+->?>�@=9(6FG+;A/@=H/BD43%(Rr@=)?H1%(+1>07=[568Rr)OT5R"+-@=)?H1%�W� �� � � 4 �^����������!��^� ���^� �#� � �'08$&%('*),+-%b>?+1%3214(+121687p+-<E6]`(+J7N),R"+1>O>?AKBD<E6"6YFIHJ<E'PflH1<L'*6�<�>?+1%3214(+121687�FQ936"<E6�+J7 � {�� BDH1<=fZ_+->?)?7=Z�)?7i'*6�7=)?21%368'd@=H�9(+1%('*>?6^H1<L'*6�<]H1<S[5H\7N)O@=)?H1%U6�>O6�2J+-%\@E>OAJW � 7S+�<=687N43>O@�n5)}@i)?7+�Z/)?7NT3@�W.�6"@K4(7K43%('*6�<E7N@E+1%('~@=936�[3<=HJ`3>?6"Z|@E93<EH1432J9h6"V3+-Z/[3>?6�7�Wdgh6��P%3HaF @=9(+-@KBDHJ<7=)OZ/[3>?6i7=6"%\@E6"%(R"6�7 )O%dq])?%('*) n*@=9(6SHJ<E'*6�<IH1B0H*R"R"43<=<E6"%5Rr6YH1B0%3HJ43%b2J<=HJ43[(7i� ���C7L�I)?743%3)?Z/[5HJ<N@L+-%\@�W � �IH1%(7=),'*6"<8nPBDH1<Q6"V*+1Z/[3>O6JnP@=936CBDHJ>O>?HaFQ)?%32_7N6�%J@E6"%(R"6�7�u� � � �cz>{��!{A�!} � } z>{��!{.� �>�`��� � �!�7�>z>{��!�A�;{>{

|!��� }7� � {,�!� � } � ���;z �;{,�!� � } � z>���}7� � { � }��� �;} |!�,� � { � } { � z>���}7� �;� �7��} � ���;z ��

� � � �cz>{��!{A� �>� ��� z>{��!{.�!} � } � �!�>�7z>{ �!�A�;{>{ � � B%� � �;�>�>z z>{��!{A���>� ��� z>{��;{A�!} � } �!�A�;{>{ op:J6"%#@=93HJ43219#@=9(6G@=93<E6"6G%3HJ43%/21<EH143[(7 H*R"R"43<�)?%/'3)}��6"<E6"%\@pH1<L'*6�<m@E936Q21<EHJ7E7 Z/6�+-%3f)?%32UH-BG@=9(6/@=93<E6"6b7=6"%\@E6"%(R"6�7C),7@=9(6�7=+1Z�6JWb$&%�+1>O>�@E93<E6"61nm@=9(6_`5HaA~)?7^@=936_2J)O:J6"<8n�'� �)�;�p k� �)� ( � � � ¥ �;��� � �1�.� ¥ �I���t§�� � ( * /1* /�;�)�;�t k� �)� ( ���k�1����� � �*� ( � ���k� �L¤�¤ � �L� � � ��¥ � � � � ¥ ��O� ¤�¤ � & ¥ � ¢ � � �;�)�;� � �-� � � � ( � ���k� �L¤ ����¢;� �L£r� � ×]� � £k¥ � # �k�(� � ���k� � � ���1� � ( � �k�;�)�;� �k� � ( � � ( ¥ ��;�)�;� #a¥&� �)*

v,y �

Page 148: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v,y � ��������� �� � � �����%��I$&%��$&��%�� �%V� !#��� ���

@=9(6Y<E6�Rr)?[3)?6"%\@t),7�@E936Y2J)O<E>�nP+-%5'�@=936SH1`�(�68Rk@p@E9(+a@ )?7t21)?:16"%_),7t+�\(HaFI6�<�W�q]HaF F H143>,'@=9(6�7=6�`56hR"+1[*@=43<E6�' `PA + � {�� �s�P)?%(R"6 � {��C7b6rV*[3<E6�7E7�[eHJ7=)}@E)OHJ%y)O%*BDHJ<=Z_+-@=)?H1%<E6�+1'3)O>?A1n*F 6R"+-%dFQ<E)}@E6C@=936CBDHJ>O>?HaFQ)O%(2#2J<E+1Z�Z_+1<�u� � { W v � � � ��� � � �� � { W z � ��� � +1':( �^%�[3[3f Z_+-<E�16�<� � { W y � ��� � [3<EH1%3HJ43%��\[3<=HJ[56�<Nfl%3HJ43%� � { W ©\� � � � '*6��\95+1+� � { W � � [3[*flZ_+-<E�16�< � %36 �\�JH �37N6 � ��]H1@=6i@=95+a@ ��� +-%5' � � �D:J6"<E`�2J<=HJ43[5�I<E6�c\43)?<=6S@=936�)O<SRrH1%57�@E)}@E436"%\@E7 @EH_H*R"Rr4(<)?%�Rr6"<=@E+1)O%�HJ<E'*6�<QFQ93),RL9�R�+-%U`e66rV*[3<E6�7E7N68'd`\A � {����D<E43>?6�7^� � { W z � @=H�� � {IW ©\�=�kW$&%�@E936UR"+J7N6�H-Bi+~7N6�%\@=6"%5Rr61nI93HaF 6":16�<�n�+1>O> @=95+a@�@=936URrHJ%\@=6rVP@�BD<=6�6�<E43>?6h� � { W v �6rV*[3<E6�7E7=6�7�),7b@=9(+-@d)?% + 7=6"%\@E6"%(R"6h��nG%3HJ43% 21<EH14([(7�� ���C7L�bR�+-% R"H1Z/6�)?% +1%\AH1<L'*6�<�BDH1>?>OHaF 6�'�`PA#+^:16"<E`/21<EH143[U� � ��kWPXG93)?7t)?7t+1Rk@E4(+->?>?A�7E+;AP)O%32C[3<E6�R")OHJ4(7�>?)}@=@=>?6 �

�]H1@=93)?%32C9(+J7m`e6"6�%�7N@E+-@=68'#+1`5HJ4*@�@=936G%P43ZK`e6"<�H1B � �C7�FQ93)?RL9/R"+1%KH*R"R"43<8WmXG93),7�)?7RrHJ%\@=<EH1>?>O68'#`PAK@=936S:16"<E`/)O% � ��nJ`34*@I@=936�<=6Y'3H\687�%3H1@I+-[3[e6�+1<�@=HK`56Y+1%PA�R"H1Z/[(+1Rr@FG+;AY@EHS7N@E+a@E6p@E93)?7m)?% � {���W �]H1@=93)?%32S9(+170`56�6"%#7N@E+-@=68'^+-`eH14*@ FQ9(+a@ [5H\7�@=f [eHJ7=)O@=)?H1%Z_+-<E�16�<E7��[3[*flZ/+1<=�J6"<k� Z_+;A�H*R"R"43<8W]XG93)?7Y)?7S'*6r@E6"<EZ/)O%368'U`PAb@E936K:J6"<E`�21<EH143[�+J7'*),7=R"4(7E7N68'�)O% �I9(+1[�W � W�W 4*@C+-2\+-)?%�@E936"<E6^),7]%3H�RrH1Z/[(+JRk@YFG+;A�@EHb7N@E+a@E6@=9()?7�W]$lBF 6Y@E<=A/@EH#6"VP[(<=687=7t@=93),7 )O% � {���n*7=6"6iFQ9(+a@G9(+1[3[56�%(7 @=H#@=9(6S<E6�7=43>O@=)?%32#2J<E+1Z/Z/+1<BDH1<]7E+;A7)�'*6"�P9(+E+���7=6"6;�kW� � ��� %36 ���m�JH ��� � � �

��� �1H ���m%(6 ��� � � ������

� � � �8+1':( � �^%{3HJ<]@E936^@E93<=6�6K%3HJ43%U21<EH14([(7^������BDH1>?>?HaFI68'�`PA�[eHJ7N@Nfl[5H\7N)O@=)?H1%UZ_+-<E�16�<L� F 6^9(+;:J67=)}Vw<=43>?6�7�WyXG9P4(7"n @EHh6"V*[3<=687=7�@E9(+a@ ��� �� � � � � ��� � � � �(���-� � �]F 6U9(+;:16�9(+J'�@EH)?%(Rr<E6�+J7N6S@=936%P43Z#`56�<]H-B 21<L+-Z/Z_+-<G<E43>O687"W

$lB3F 6p@E+1�16I)O%\@=Hi+1R�RrH14(%J@m@=936IB�+1Rr@0@E9(+a@�'*6"[e6"%5'*)O%(2SHJ%@=936GX � X >,+-`e6">�� @E6"%(7=6rf+17=[e6�Rk@=f Z/H*'3+1>O)O@�Ab>,+-`e6"> �QH1B @E936^:J6"<E`�n3@E936K[eHJ7N@Nfl[5H\7N)O@=)?H1%�Z_+-<E�16�<]F H143>,'d`56�'*)}B fBD6"<E6"%\@8n*@=936%P43Z#`56�<QH-B <=43>?6�7G)?%(R"<=68+17=6�7 6":J6"%dBD43<=@=936�<�u� � ��� %36 ���m�JH ��� '3)OA\+1+� � ��� �1H ���m%(6 ��� '3)OA\+1+

������ � ��� ���m�JH ��� '36r@E+J+�936")�����6r@ER1W

� %36^R�+-%�7=6"6C@=95+a@ � {�� ),7]%(H-@S'*687N)?21%(6�'d@=H_95+-%('*>?6BD<E6"6^F H1<L'PflH1<L'*6"<8WtXGF H[3<EH1`3>?6"Z_7SH*R"Rr4(<�uQ{ )O<L7N@�ne@=H�R"+1[*@=43<E6BD<E6"6�FIHJ<E'*f HJ<E'*6�<QFI6#9(+;:16^@=Hd)O%(R"<=68+17=6@=9(6%P43ZK`e6"<bH-B<=4(>O687"W �P6�R"H1%('�n BD<E6"6�F H1<L'PflH1<L'*6"<�>,+-%32J4(+-2J6�7/9(+;:J6�+s<E),RL9 7=A*7�@E6"ZH-BQR"+J7N6/6�%('*)?%32J7�Wb{(+1<BD<EH1Z R�+-[*@E43<=)?%32d@=95+a@K<E)?RL9(%36�7E7"n0)}@K>?6�+J'37i@=HUAJ6r@^2J<=68+a@=6�<)?%(Rr<E6�+J7N6])?%_@E936S%P43Z#`56�<IH1B�<=4(>O687"W�{ )O%(+1>O>?A1nPFQ9(+-@I)O@G'3H\687IR�+-[*@E43<E6YRrHJZ�[5+1Rk@E>OA/)?%� � { W v ��D@=9(+-@ � � H*R"Rr4(<E7]+-@]@=9(6^6"%('5�kn�R"+-%�`e6KR"+1[*@=4(<=68'�`\A�<=6�2143>,+-<Q2J<E+1Z/Z/+1<

Page 149: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �,����!#%V� P$]��%��� ��� ���P$ �P$]����P$]��% v,y �H1<GT5%3)}@E6^7�@L+a@E6iZ_+JRL93)O%(6�7�W�XG9(6[5HaF 6"<QH1B � {��C7G),7Q%3H1@]%36"68'*6�'�W

� .- �U�U��� ��!"�#� ��� � 6 0Y�]!���� �i��!"�#�.�6"@Y4(7G@E<=A�@=H�7=H1>?:16i@E936^[3<EH1`3>?6"Z_7G@E9(+a@SFI6�<=6CB�+JRr6�'d)?%�@=<EAP)O%32/@EH_4(7=6 � {���n3`PA4(7=)O%(2�BD43%(Rk@E)OHJ%(+->I7N[e6�R")}T5R�+a@E)OHJ%�Wb{3HJ<6rV3+-Z/[3>?61nm)}BQF 6_FIHJ<=�UFQ)O@=9 <E43>?6�� � { W v �knF 6GR�+-%/+17E7NH*R")?+-@=6I+SBD43%5Rk@=)?H1%5+->37=[568Rr)OT5R"+-@=)?H1%#@=9(+-@�[(43>O>,7�HJ4*@�[5H\7�@=f [eHJ7=)}@E)OHJ%(7 )O%\@EH@=9(6CBD43%(Rk@E)OHJ%(+->m7�@E<=4(Rr@=43<E61W�XG9P4(7�n*FI6Z/)?219\@Q9(+;:16i@E936CBDH1>?>OHaFQ)?%325u� � { W v � � � � � � � ���{���W v � � � � [([5� ��� � ���

� � { W z � ��� � +J' ( �#% [3[*flZ_+-<E�16�<��{���W z � � [3[ ��� [3[(Z� � { W � � [3[*flZ_+-<E�16�< � %(6�� �1H ���{���W � � � [3[(Z � 6�<=25W � [3[3Z � '3+-@�W

�JH � �� [3[(Z � +JR"R � [3[3Z � %3HJZ$l@I),7p%(H-@ '3)}��Rr4(>}@I@=H#7=6"6]@=9(+-@t@=9(6]B f&7�@E<=4(Rr@=43<E6QBDHJ<p@=9(6S7=6"%\@=6�%(Rr6K��ª3W v ��F H14(>?'_`e61u[3<E6�' � �i$ �So � � 6"<E2(n � %3HJZ�n � '3+a@Y� �6"<E2 � [3<=68' � W � � � �'3+a@ � [3<=68' � �i$&U]. � �%3H1Z � [3<=68' �={�. � g o�U � �XG936�7=+1Z�6KB fl7N@=<E4(Rr@=43<E6KF H143>,'�`e6�[3<=H*'*45Rr6�'UBDH1<C7N6�%J@E6"%(R"6�7���ª(W z �kn���ª(W y �]6"@ER-WXG9P4(7�n�@=936/[3<EH1`3>?6"Z H1BIF H1<L'UH1<L'*6"<i),7Y@L+-�J6"%�R�+-<E6#H1Bt4(7=)O%32�BD43%(Rr@=)?H1%(+1>�7N[e6�R")}T3fR"+-@=)?H1%d<=687N4(>}@E)O%32/)?%U+�R"H1Z/[(+JRk@Q21<L+-Z/Z_+-<8W$l@~),7~)OZ/[eH1<=@E+-%\@8nK93HaF 6":J6"<8nC@=H >?HPH1� Rr<E)}@E)?R�+->?>OA +1%(' 7=6"6�FQ9(+-@~9(+J7�`e6"6�%+1RL9()O6�:16�'�W � >?>S@E9(+a@U9(+J7b`e6"6�%�'3H1%36h)?7�@E9(+a@�@=9(6~[eHJ7N@Nfl[5H\7N)O@=)?H1%57�95+;:16�`e6"6�%7=6"[(+1<E+-@=6�'�+-%('U>?),7�@E6�'�%(6rVP@C@=H�@E936/%3H14(%�21<EH143[57"WC$&%�B�+JRk@8n�+->?>0@E93)?7R"H143>,'U9(+;:J6`e6"6"%�'*H1%36G@E<=)?:P)?+1>O>?A�)O%_>?)O%(6�+-<t@=)?Z/6]4(7=)O%32#+CT(%3)O@=6i7�@L+a@=6YZ/+JRL93)?%36G@=HJ216r@E936"<IFQ)}@E9+-%U+1`3)O>?)O@�A�@=Hb>O),7�@Q@E93)?%32J7�W XG9(6[5HaF 6"<QH1B � {�� +1%('dBD43%(Rr@=)?H1%(+1>07=[568Rr)OT5R"+-@=)?H1%�)?7%3H1@]4(7N68'�W q]HaF FIHJ43>,' @E93),7�7=AP7N@=6�Z 9(+1%('*>?6 @=9(6 '*6"[e6"%5'*6"%(R"6 H-B/@=9(6�[5H\7�@=f [eHJ7=)O@=)?H1%Z_+-<E�16�<E7KH-B]%3HJ43% 2J<=HJ43[(7^HJ% X � X >,+-`e6">GH1B]21<EH143[(7���XG936�7=6bF H14(>?' `56d9(+-%3f'*>?6�'�`PA�Rr<E6�+a@E)O%(2�ZK4(>}@E)O[3>?6d6"%\@=<E)O687�)O%�@=936d>?6rV*)?R"H1%�W�{3H1<�6rV3+1Z�[(>O6JnpFI6dZ/)O2J9\@9(+;:J6Y@E936CBDH1>?>OHaFQ)?%32/�P)O%5'37GH-B�6"%\@=<E)?6�7G)?%�@E936>?6rV*)?R"H1%�u'*)?AJ+J+���2J+;:16;� ������ � � � ��� � � � � � � � � � � � ��� � � �

�G ¥ � � � ¥ �� k�;�k� ¥ � � � ¥^��× ¢;�� )�;� � � �L�I� £ � ¡ � ¥ � ¥ * � � �l� ��× ¢;�� )�8� � � ��� � ( �)� ��¦ ( �)� � � ���k� #×]� � £k¥ � &��)� ¤ �i���;��� ¥N� � ¥�� � ¥ �� × ¢ ¥ ���L� ( �)� � ��¢ ¤�¥ � ¦ � � � �;� � �;� ¥ � *

Page 150: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

v,y%# ��������� �� � � �����%��I$&%��$&��%�� �%V� !#��� ���

'*6"@E+1+�936�)p�D2J)O:J6�7L��������� � ����� � � � � � � � � � � � ��� � � � �'*)?AJ+J+K2\+;AJ+1+���R"H143>,'d`562J)O:J6"%5��������� � ����� � � � ��� � ��� � � � � � � � � � � �

gh6">?>}f BDH1<EZ/6�'*%3687=7mRrHJ%('*)O@=)?H1%^HJ%CB fl7N@=<E4(Rk@E43<E6pFIHJ43>,'R"+-457N6t+1>O>\`34*@ H1%36tB fl7N@=<E4(Rr@=43<E6@=H�`e6i<E6&(�68Rk@E6�'�W3W 4*@G@=9()?7 Z/)O2J9\@ @E43<E%bH143@ @EH#`e6C:16�<=A_6"VP[e6"%57N)?:16JW�XG9(6"<E6SF H143>,'`e6pHa:16�<=9368+1'YH-B*<=6�[568+a@E6�'CRrHJ%(7�@E<=45Rk@=)?H1%iH-BPB f&7�@E<=45Rk@=4(<=687�+-%('S@E936"%C@E936")?<�<E6&(�6�Rr@=)?H1%�WXG936�<=6iFIHJ43>,'�`e6^+-%3H1@=936�< [(<=HJ`3>O6�Z_+a@=),Ri+17=[568Rk@�W � [eH1)?%\@=6"< @EH�)O@]+-[3[e6�+1<E7 )?%@=9(6�>?6rV*),R"+1> 6�%\@=<EA�BDHJ<") '*6"@E+J+b936�)>+?WKXG936�<=6/+-<E6#@�FIH�%3H1Z/)?%(+a@E)O:J6�7i)O%h+�7=6"%\@E6"%(R"6FQ)O@=9/@=9()?7pBDH1<EZ H-Be@=9(6]:16�<=`�W q]HaFwFIHJ43>,'K@E93HJ7=6Q`e6]9(+-%5'*>O68'��d$lB�+C[5H\7�@=f [eHJ7=)O@=)?H1%R"+1%�<E6"[e6�+a@8n5F 6KFQ)?>?>m9(+;:J6@=HbBDH1<EZ 7N6"@E7i+-%('URL9368RL�dBDH1<YZ/6�ZK`e6"<L7N93)?[�)?%���{���W v �<L+a@=9(6"<G@=95+-%d6�c\4(+->?)O@�A1W��{���W v ��� ��� � � � [3[e��P)?Z/)O>,+-<E>OAJnCH1[*@E)OHJ%(+->[eHJ7N@Nfl[5H\7N)O@=)?H1%57�FIHJ43>?' )?%J@E<=H*'*45Rr6�+1'('*)}@E)OHJ%(+->^+1ZK`3)?214()}@�AJWXG936^7=H1>?4*@=)?H1%d%3H/>?H1%32J6"<G>OHPHJ�P7Q+J7G%36�+-@�WXG936�Z/HJ7N@C)?Z/[5HJ<N@L+-%\@[5HJ)O%\@),7Y@E9(+a@^+1>O>�@E93)?7R"H143>,'~9(+;:16#`56�6"% '*H1%(6#Z#4(RL9Z/H1<E6Y6"�_R")O6�%\@=>?A�`PA�+KZK4(RL9b7=)?Z�[(>O6�< 2J<E+1Z/Z/+1<�W XG936i[5HaF 6"<IH-B � {�� +-%('�BD43%(Rkf@=)?H1%5+->�7=[568Rr)OT5R"+-@=)?H1%�n*@E9(+a@Q),7"n3@=936[eHaFI6�<GH-B�.0{�� )?7]%36")O@=936�<]%36�6�'*68'�n*%3H1<Q457N68'�W� JB�Q,N�� B H�� G��D��

XUHJ9(+-%(+1% � v ª #\z �]'3)?7ERr4(7E7=6�7S@=936/%36�6�'�BDH1<i@=936�BD43%5Rk@=)?H1%5+->�>?6":16�> BDH1<�X�+->,+;A\f+->,+-Z ��+YZ_+:(�HJ<m$&%5'*)?+1%K>,+-%32J4(+-2J68�rWmq]6 <E6&(�6�Rr@E7m@=9(6I%36�6�'KBDH1< [5H\7�@E43>,+a@=)?%32C7N4(`�(�6�Rr@BDH1<Y)}@])?%d@=936KR"H1%*T52143<L+a@E)OHJ%(+->�7=6"%(7=61W �i4([*@E+/6"@S+-> WY� v ª #%# � '*),7=R"4(7=7Q7=H1Z/6),7=7=43687)?%UFQ<=)O@=)?%32�+_2J<E+1Z�Z_+1< )?%�.0{�� BDH1<YqY)O%('3)�W]�P6�%32143[3@E+U� v ª1ª y � 6rVP@E6"%('37S.0{�� @EH9(+1%('*>?6K$&%('*),+-%U>,+-%(214(+1216�7�W W 4*@i7N@=)?>O>m@=9(6K%36�F�6"VP@=6"%5'*6�'�.m{�� 2J<E+1Z�Z_+1<Q9(+17S+ZK45RL9~2J<=68+a@=6�<S[eHaF 6"<i@=9(+1%~%(6"6�'36�'�n0@=9(+-@C),7�n0)O@+JR"R"H1Z/[3>?)?7=936�7C7=H1Z/6r@E93)?%32d@=9(+-@R"+1%�`e6^'*HJ%36`PAb+�ZK4(RL9�7N)?Z/[3>?6"<]2J<E+1Z�Z_+1<�W

Page 151: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� ���

� � � � � ������� �� � ����� � ���

������� ����� ��!#"%$���&#�('*),+-"%.�./"�+-01"%23'4��56!#"%$��87:9;�<>=@?A=(BC?A=EDGFEH�I>?AHJIK=@?LDNMO=QPRHTSVUC?WBTXYXZBT?WP[DA<\BTD]BT?N=#^_=@PAMO?WBT`\aO=Jbcad=fe_Mdg@BTadMOhQBiDNMOHJjkBCj\^adHlg@BTadMmDGnVo�pqDZ<\BJPk`K=@=�jrPL<>HiF#js`ln�?A=Qgf=@jJDYFEHC?NtuMdjvaOMdj>UCw\MdPLDAMxg�PYBTjK^zy�{[|}DA<\BTDad=fe_Mdg�HCjYI>axB~n_P-B��C=�?Nn%MdXYIKHJ?LDWBTj�D�?AHJaO=#MdjYUC?WBTXYXZBT?Qo[|�?AHJIK=@?LDNMO=QP-BCPNPLH_gfMxBiDN=@^�F#MmDN<ad=fe_Mdg@BTa[MmDN=�XZP�BC?A=�MOXYI:HC?ADNBTj�DQ�KBTjK^�X�w\PLD�I\adB~n3B6gf=@j�DA?WBTa�?NHCad=%Mdj�DA<>=�UC?WBTXYXZBT?Qo{�=�e_Mdg@BTadMOhQBiDAMdHCj�UCMd�C=QP�=fe_I>?N=@PNPLMdHCj�DAHkDA<>=%g�=�j�DA?WBTa�?NHCad=�HTS�aO=�elMxgfHJj�o� �J�R�����@���K�}�G���������C�>�����C�l� ��¡i�>¢�¢��>¡T£i¤�¥}UC?WBTXYXZBT?(MxP¦PABCMd^3DNH�`:=�§d¨A©Jª¬«­W® §¯ªO°Q¨W±�MOS² =��C=@?An6³\j>MODA=�PLDA?Nw\g8DNw>?N=�HTS�DA<>=%UJ?NBCXYXYBC?#MdP�BCPNPLH_gfMxBiDN=@^�F#MmDN<�HCj>=�HJ?(XYHC?N=aO=�elMxg�BCa_MmDN=�XZP@oR;�<\=�BCPNPLH_g�MdBTDA=@^�ad=fe_Mdg@BTa>MODA=@X�´�PWµRMdP�´�BC?A=~µRg�BTadad=@^�DA<>= ®i¶:­W·>¸T¹HTS�DA<>=�gfHC?N?N=@PAIKHJj\^_Mdj>U�PGDN?Aw\gfDAw>?N=C��F#<>MxgW<ºX�w\PLD�`:=�?N=@BCaOMdh�=Q^»Hi�J=�?ADAadn¼Mdj�BPL=@jJDN=�j\g�=¦DA<\BTD(MdP#^_=@?AMd�C=Q^�wKPLMdj>UkDA<>=%PLDA?Nw\gfDAw>?N=Co² ;�<>=�?N=]BC?A=�HJj>=EHC?cXYHJ?A=]HCI:=�?WBiDAMdHCjKP�S�HJ?�g�HCXYIKH�PLMdj>U�DA<>=�PGDN?AwKg8DAw\?A=QP�oc;�<\=@PA=HCI:=�?WBiDAMdHCjKP]HJj PLDA?Nw\gfDAw>?N=@P#BC?A=�w\PA=@^�MOj�^_=@?AMd�lMOj\UYPA=�j�DN=�j\g�=@P@o¥�DGnlI>Mxg�BCacgfHJjJDN=felD(S�?N=�=�UJ?NBCXkXZBC?(gfHCjKPLMxPGDWP#HTS-?Nw>ad=@P%´�F#<>MdgW<»BT?N=¦?N=fS�=@?A?N=@^�DNHBCP%³\j>MODA=3PGDN?AwKg8DAw\?A=QP%Mdj�DA<\=�BT`:Hi�C=�^_=f³\j\MmDNMOHJjKµ8��BCj\^½DA<\=�HJIK=@?NBTDAMdHCjºMxP%DN<\BiDkHTS?N=�F#?NMmDNMOj>U»HC?YPLw\`\PGDNMmDNw_DAMdHCjcoz¾lw\gW<zB»UC?WBTXYXZBT?�F#MOada�`K=�DA=@?AXY=@^sBCP�aO=�e_Mdg@BTadMOh@=@^MOSG��BTj\^�HJj>adn MOS�=��J=�?NnC�:?Aw\aO=�MdP�BCPNPAHlg�MdBTDA=Q^3F#MmDN<¿BTj¿BCj\gW<>HJ?@o¦{cÀ[ÁÂUJ?NBCXYXYBC?(S�HJ?Ã�j\UCadMdPA<3DA<\BTD¦FE=�<KB~�C=%PA=�=�j¿MOj½¾l=@gCo�Ä>o ÅZMxP¦j>HTD¦aO=�elMxg�BCaOMdh�=Q^3`K=Qg�BCw\PL=�j>H�ad=fe_Mxg�BCaMODA=�XÆMdP�BCPNPLH_gfMxBiDN=@^���S�HJ?#=fe>BTXYI>ad=C�_F#MODA< DA<\=�?Aw>ad=Zb¾¿Ç:È y�| ɦ|;�<>=3PL=QgfHJj\^ºMdXkI:HC?ADNBCj�DkI>?NHCI:=�?ADGn½MdP�adHlg@BTadMmDGnVo�ÊEn˧ ¸Q­W® §¯ª¬ÌÎÍ�MxPkXk=QBTj�DkDA<\BTDBTjln�gfHJj\PLDA?WBTMdjJD�HC?¦I>?AHJIK=@?LDGn Mdj¼DA<\=�UJ?NBCXkXZBC?(MdP�PAIK=QgfMO³\=@^¿Hi�C=@?�B�PAMOj\UCad=�³\j\MmDN=PLDA?Nw\g8DNw>?A=Jo�¾lw\gW<�g�HCj\PLDA?WBTMdj�DNPEPL<>HJw>ax^Zj>HTD�PLIKBTj�Hi�J=�?�X�w>aODAMdI>aO=¦³\j\MmDN=¦PLDA?Nw\g8DNw>?N=@P@o;�<lw\P@��MOS(FE=6<\B~�C=6BCUC?N=�=@Xk=@j�D%`K=�DGF]=@=�jzPAw>`_ÏG=Qg8D�y�|ÐBTjK^½�C=�?N`ºMdj�B¼PL=@j�DA=�jKgf=C�

Ñ ÅCÒ

Page 152: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���� �������� ������������� � ����������������! " #����$%$%���

MOD PA<>HCw>ax^Ë`:=¿=�elI\?A=QPAPAMO`\aO=�MdjËDA=@?AXZP�HTS�B�PAMOj\UCad=¼³\j>MODA=uPGDN?AwKg8DAw\?A=z´�M�o =Cod�(?Nw>ad=Qµ8o¾lMdXYMOaxBT?NaOnJ�_MmSRHCj\=¦MxP�UCMd�lMOj\UkPA=�XZBTj�DNMdg@PEDAHkDA<>=�^_=@?AMd�C=Q^�PLDA?Nw\gfDAw>?N=@P@�_MmD#MxP�UCMd�C=@j�MdjDA=@?AXZP]HTS�w>j\MmDWP]g�HC?N?A=QPLI:HCj\^>MOj>U�DNH%DN<>=�³Kj>MmDN=�PLDA?Nw\g8DNw>?N=@P]w\PL=Q^ZMdjZDA<>=�^_=@?AMd�iBiDAMdHCjc�BTjK^6DN<>=�Md?�gfHJXYIKH�PLMODAMdHCj�o�����'& ����� ��!#"%$���&#�(')(s+-�(�+*-,/.30�7-�W7�,�7-�f5k2),+-"%.�./"�+¥ ;[?A=@=�¾lw>`\PLDAMODAw>DAMdHCj¿Á¦?WBTXYXZBT?%´�;(¾\Á�µ#gfHJj\PLMxPLDNP#HCS�Mdj>MODAMxBTa�DN?A=@=@P#BCj\^ DA<>=%PAw>`10PLDAMODAw_DNMOHJjzHCI:=�?WBiDNMOHJj�o»¾lHJXY=6=fe>BTXYI>ad=�Mdj>MODAMxBTa]DA?N=�=QP�BC?A=6UJMO�J=�jºMdjzÀ�MOUJw>?N= Ñ2� o Ñ o¥(jvMdj>MmDNMdBCaEDA?N=�= MdPYB�DN?A=@= PLDA?Nw\gfDAw>?N=�<KB~��Mdj>U»j>H_^_=@PkaxBT`:=�adaO=Q^�`lnºj>HCj30�DN=�?NXkMdj\BCa

4

44

4

5�6�7985;:=<?>5�7

5A@'BDCFE5�GIHKJ

LNMPORQ

S?T�UV

WW

W X

Y�Z3[

XW

\?V^]

_

Xa`Xa`

Xa`

_/`Xa`

b

À�MdUCw>?N= Ñ2� o Ñ b�¾lHJXY=¦=�e>BTXYI>ad=¦Mdj>MODAMxBTa�DN?A=@=@PBTjK^6DN=�?NXkMdj\BCacPLnlX�`KHJadP�`>w>D(F#MmDN<3PAHCXY=�?N=@PLDA?NMdgfDAMdHCj\P@b-¥(ada�DA<>=�ad=@BTS�j\Hl^>=@P�HTS�DA<\=DA?N=�=#BC?A=�axBT`:=�adaO=Q^�`ln%=@MmDN<>=�?-DN=�?NXYMOj\BCadPRHJ?Rj>HCj10ÎDA=@?AXYMdj\BTaxP2cTMOjkDN<>=#adBTDLDN=�?�g�BJPL=J�iDA<\=ad=@BiS-j>H_^_=QP(BT?N=%g�BCaOad=@^�PAw>`\PLDAMODAw>DAMdHCj�j>H_^_=QP�BTjK^ BC?A=�XZBC?AtJ=@^ `ln�B6^_HiF#j�BC?A?NHiF�op j�g�BJPL=�=��J=�?Nn6Mdj>MmDNMdBCa�DA?N=�=�<KBCP#BiD(ad=@BJPGD(HJj>=¦DA=@?AXYMdj\BTacPAnlX�`:HCaÎ�_DA<\=�UC?WBTXYXZBT?�MdPg�BCaOad=@^�ad=fe_Mdg@BTadMOh@=@^ ;(¾>Áko;�<>=EPLw>`KPGDNMmDNw_DAMdHCj%HJIK=@?NBTDAMdHCj%BCaOadHiF(P�w\PcDAH¦^_=�?NMO�J=�j>=@F½DA?N=�=@Pc`ln¦?N=�I\adBJgfMdj>U#DA<\=PAw>`\PLDAMODAw_DNMOHJj j\Hl^>=@P�Mdj Mdj>MODAMxBTa�DN?A=@=@PE`ln�HCDA<>=@?]DN?A=@=@P@o�À>HJ?E=�e>BTXYI>ad=C�\À�MdUCw>?N= ÑR� oedPA<>HiF(P¦DA<>=Z?N=@PAw>aOD�HTS#PLw>`KPGDNMmDNw_DAMdj>U 5A:=<?> Mdj 5fGIHFJ o6p j_S�HC?NXZBTadaOnJ�cB DA?N=�=YHJ`_DNBCMOj>=Q^`ln�PLw\gW<uPL=Rg�w>=�j\g�=�HCS]PLw\`\PGDNMmDNw_DAMdHCjKP�MxP¦g�BTadad=@^¿Bu±C¨ ¹ ªih~¨W±�DA?N=�=Jo�¥ DN?A=@=�MxP�g@BTadaO=Q^­W¸�jk §O¨�Ì ¨N±#MmS�BTada>MODNP�aO=QBiSVj>H_^_=@P�BC?A=�axBT`:=�adaO=Q^Y`ln%DA=@?AXYMdj\BTaKPLnlX�`:HCaxP@oR¾lHJXY=#MOj>MODAMxBTaDA?N=�=QP-BT?N=#gfHCXYI>ad=fDN=@^��CS�HC?�=�e>BTXYI>ad=C� 5�7 BTj\^ 5A:=<R> o�l]HJXkI\aO=�DA=@^�DN?A=@=@P-g�BCjZBTaxPLH�`:=^_=@?AMd�C=Q^kS�?AHJX}Mdj>MODAMxBTaKDA?N=�=@P�`lnkPAw>`\PLDAMODAw_DNMOHJj6HCI:=�?WBiDNMOHJj��TS�HJ?�=�e_BCXYI>aO=J�JMdj À�MdUCw>?N=Ñ2� o d>oy(H_^_=QP�MdjsB¿DA?N=�= g�BCjz`:= BJPAPAMOUJj>=@^ºBJ^>^_?N=@PNPL=QP�onmu= F#MdadaEwKPL=3Á¦HC?Nj ´ Ñ ÒporqJµBC^\^_?A=QPAPAMdj>UYF#<>MdgW<�BJPAPAMOUJj\P#BC^\^_?A=QPAP � BTD(DA<>=�?NHlHTD(j>H_^_=�HCSRBkDN?A=@=Co�Ã]BCgW< HTSRDA<\=tZgW<>Mdad^_?N=�j�HTS�DA<\=�?NH�HCD]j>H_^_=�MdPEBCPNPAMOUJj>=@^ZB�jlw>X�`K=@?�S�?NHCX Ñ DAH�tYMdj6ad=fS¬DEDAH�?NMdUC<�D

Page 153: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� � ���; ��������� ���N � ���� � �� ���;�f������f��� � #����$%$%�� Ñ��KÑ

Y Z1[S?TfU

XW

Xa`

À�MdUCw>?N= Ñ2� oed_b��#=QPLw>aOD(HTS-PAw>`\PLDAMODAw_DNMOj>U 5 :=<?> Mdj 5 GIHFJHC?W^_=@?@oRÀ>HJ?EBCj�nYHCDA<>=@?Ej\Hl^>=�MOScMODEMxP]DA<>=��ÎDA<�gW<\MOax^6HCScMmDWPEI\BT?N=�j�D@�_BCj\^ZDN<>=�IKBT?N=�j�D<\BJP�BTj6BJ^>^_?N=@PNP��c�CDA<>=@j6MODNPEBC^>^_?N=@PNPRMxP���� �WoRÀ>HC?�=fe>BTXYI>ad=C�l;�<>=#³\?WPLD]y�|ºMdj 5�6�798<\BJPEDA<>=%BJ^>^_?N=@PNP Ñ �>F#<>MdaO=¦DN<>=%PL=QgfHJj\^�y�|r<\BCPEDN<>=%BC^\^_?A=QPAP#d>o d>oy(HiF F]=�BC?A=¦?A=QBC^_n6DAHZ^_=f³Kj>=�DA<>=%PAw>`\PLDAMODAw>DAMdHCj3HCI:=�?WBiDNMOHJj�o� �J�R�����@���K� �����������Q�����c�Q���:�����]�J¡i�_�Q���:�R£i¤E¾lw\`\PGDNMmDNw_DAMdHCj HCI:=�?WBiDNMOHJjZDNBCtC=QPBTjr´�Mdj>MODAMxBTa-HJ?�B3^_=@?AMd�C=Q^\µ(DA?N=�=C�[BTj½BC^>^_?N=@PNP�MOj½MOD@�cBCj\^»B gfHJXYI>aO=�DA=Q^¼DN?A=@=C�cBCj\^?N=�I>axBCg�=@PRDN<>=�j>H_^_=¦BiD]DA<>=¦PLI:=@g�Mm³\=Q^6BC^\^_?A=QPAP�MOjZDN<>=(³K?NPLD�DA?N=�=�`ln�DN<>=�g�HCXYI>ad=fDA=Q^DA?N=�=#I\?AHi�lMx^_=@^�DA<>=(S�HCadaOHiF#Mdj>U¦DGF]H%g�HCj\^>MmDNMOHJj\P�BT?N=#PABTDAMxPG³K=@^�bcDA<>=�BJ^>^_?N=@PNPL=Q^�j\Hl^>=MxP(BZPLw\`\PGDNMmDNw_DAMdHCj3j>H_^_=%BCj\^ MmDWP#axBT`:=�acMxP�DN<>=%PABCXY=�BJP�DA<KBiD(HTS�DA<\=%?AHlHCD�j\Hl^>=�HTSDA<\=%gfHCXYI>ad=fDN=@^�DA?N=�=Jo� �J�R�����@���K�º�L����¡i�! :���#"]¡i�l�_£i¤�¥�^_=@?AMd�C=Q^¦DA?N=�=�MxP�HJ`_DNBCMOj>=Q^�`ln¦PAw>`\PLDAMODAw_DNMOj\UB�gfHJXYI>aO=�DA=Q^»Mdj>MODAMxBTa�DA?N=�=ZMdj½BCj½MOj>MODAMxBTa�DA?N=�=J�cHC?�`lnuPLw>`KPGDNMmDNw_DAMdj>U¿B�g�HCXYI>ad=fDA=Q^Mdj>MmDNMdBCa�DA?N=�=�HJ?(gfHCXYI>ad=fDN=@^ ^_=�?NMd�C=@^�DA?N=�=�Mdj3BTj3MOj\MmDNMdBCa�DA?N=�=�HC?(BY^_=@?AMd�C=Q^6DN?A=@=CoÀ�MOUJw>?N= Ñ2� o Å�PA<>HiF(P��iBT?NMOHJw\P�PAw>`\PLDAMODAw>DAMdHCj\P�j>=@g�=@PNPABC?An¿DAH¼HJ`_DNBCMOj�B¼^>=�?NMO�J=@^DA?N=�=¦S�HJ?@b

$�%'&)('*,+.-�/10�/32541687:9

;�=�?NMO�J=@^¿DA?N=�==<?>�MxP�DN<>=6PABCXY=YBJP¦DA<>=YDN?A=@=YMOjºÀ�MOUJw>?N= ÑR� oed_o=<A@YMdP�HJ`_DNBCMOj>=Q^¿`lnPAw>`\PLDAMODAw_DNMOj>UYDN<>=�gfHJXkI\aO=�DA=@^�DN?A=@= 5 > BiD(BC^\^_?A=QPAP Ñ Mdj 5�6�798 o�<AB¦MdP�HJ`_DNBCMOj>=Q^�`lnPAw>`\PLDAMODAw_DNMOj>U 5f7 Mdj 5;@9BDCKE BTD]BC^\^_?A=QPAP Ñ o�À�Mdj\BTadadnC�C<ED@MdP�DA<>=(?N=@PAw>aOD�HTS�PAw>`\PLDAMODAw_DNMOj\UDA<\=%gfHCXYI>ad=fDN=@^�DA?N=�=�<AB�MOj DN<>=%^_=�?NMd�C=@^F< @ DN?A=@=%BiD(BC^\^_?A=QPAP#d>o d>op jYDA<\=(=fe>BTXYI>ad=(BT`:Hi�C=J�Cj>HCDA=�DN<\BiDEF]=(BC?A=#XZBTtlMdj>U�w\PA=(HTS�ad=fe_Mxg�BTadMdh�=@^Y;�¥(Á�P�oÃ��J=�?Nn�MOj\MmDNMdBCa-DA?N=�=Y<\BJP�B�ad=fe_Mxg�BCa-MmDN=�X3o6;�<>=6PLDA?Nw\g8DNw>?A=QP¦HTSEDA<>=ZUJ?NBCXkXZBC?¦BCadPAHS�HCadadHiF DN<>=kI>?AMdj\g�MOI>ad=�HCS�aOH_g@BTadMmDGn3`:=@g�BCw\PA=�=@BJgW<¼PGDN?AwKg8DAw\?A=kg�BT?N?NMO=QP#MmDWP¦I>?A=Q^_Mxg�BiDN=BT?NUCw\Xk=@j�DNP%g�HCX�`\MOj\BTDAMdHCjºBTjK^uDA<>= gfHC?N?N=@PAIKHJj\^_Mdj>U�gfHCjKPGDN?NBCMOj�DNP@o�À>HJ?%=fe>BTXYI>ad=C�5�6�798 MdP[BTj\gW<\HC?N=@^�HCj�DN<>=�ad=fe_Mxg�BCaCMODA=�XHG PAB~FJId�QF#<>MdgW<�PLI:=@g�Mm³\=QP[B�^_nJBJ^_Mdg�I>?A=Q^_Mxg�BiDN=G PL=@=5Id��BCj\^�DA<>=k´�y�|Eµ-PAaOHCDNP-S�HJ?�MODNPEBT?NUCw>XY=�j�DWP�o[pqS�BCjln�?N=@PLDA?NMdgfDAMdHCj\P�BT?N=#I>adBJgf=Q^�`lnDA<\=�I>?N=@^_Mxg�BTDA=KG PA=�=CI�HCj�MmDWP[BC?AUJw>XY=�j�DNP@��DN<>=�n%BCI>I:=@BT?�BCP[gfHCjKPGDN?NBCMOj�DNPcHCj�DN<>=EPAMdj>UCad=Mdj>MmDNMdBCacDN?A=@=Co�;�<lw\P@�VgfHCjKPGDN?NBCMOj�DNP�F]HJw>ax^3j>HTD¦`K=kPLI>?N=@BJ^3Hi�C=@?�PL=@�C=@?NBCacPGDN?AwKg8DAw\?A=QPHTS�DA<\=�UC?WBTXYXZBT?Qocp j�gfHJjJDN?NBJPGDQ�lDA<>=�S�HJaOadHiF#Mdj>U�?Nw>ad=@P�Mdj lEÀ[Ákb¾»Ç:È y�|rÉ�|ɦ|�ÇKÈ É y�|^_H j>HTD�I:HJPNPL=QPAP�aOH_g@BTadMmDGnJo�;�<\=�I>?N=@^>Mdg@BiDA=3´�BJPAPAH_gfMxBiDN=@^3F#MODA<uɦµ¦BTI>I:=@BC?NP�MOj»DA<\=PA=@gfHJj\^�?Nw>ad=C�:F#<>=�?N=@BJP(HCj\=�HTS]MmDWP�BC?AUJw>XY=�j�DNP�BTI>I:=@BC?NP�MOj¿DA<>=�³\?WPGD¦?Aw>ad=Co¦;�<lw\P��

Page 154: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�� d �������� ������������� � ����������������! " #����$%$%���

4

<ED

< B<A@< >

�����

_

Y�Z3[SRT�U

W

\RV^]

X

W

V LNMPORQ

X

Xa`

_/`Xa`

b

������ Y �

LNMPORQV

XW

Xa`

\?V^]Y�Z3[SRT�U

_XW Xa`

_/`

� V �

Xa`

b

Y�Z1[S?TfU

XW

Xa`

À�MdUCw>?N= Ñ2� o Å>b�;�=�?NMO�J=@^�DA?N=�= < DfS�HC? G DA<\=�`KHin�PNB~F BkUJMO?Na I

Page 155: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� � ���; ��������� ���N � ���� � �� ���;�f������f��� � #����$%$%�� Ñ�� Å=��J=�j½DN<>HCw>UJ<ºDA<\=�PA=@gfHJj\^½?Nw>aO=�MdP�aO=�elMxg�BCaOMdh�=Q^½MmDZ^_Hl=@P�j>HTDkPABTDAMxPGS�nuDA<\=�adHlg@BTadMmDGnI>?NHCI:=�?ADGnCo-;�<>=¦³\?WPGD(?Nw>ad=�MdP#j\=�MODA<>=@?#aO=�elMxg�BCaOMdh�=Q^�j\HC?#<\BJP�aOH_g�BCaOMODGnCo¥�P�BCj>HTDN<>=�?E=fe>BTXYI>ad=C�_g�HCj\PAMd^>=�?�BTj6Mdj>MODAMxBTaVDA?N=�=�F#MmDN<3G tlMdgWtJ=@^�IlBCP]MODNP#BTjKgW<>HC?Q�BTjK^zBTj\HTDA<\=�?�Mdj>MODAMxBTaEDA?N=�=�F#MmDN< G tlMdgWtJ=@^uDN<>=3`>w\gWtC=�D,IRBCP�MmDWPYBTj\gW<>HJ?@�-PA<>HiF#j�MdjÀ�MOUJw>?N= ÑR� o � o

4

4 4

5�� B�� � >����NG�� � >I:5�� B�� � >��

Y� �� UpSS?TfU

� M �� U �

_

XW

_

� M �� U �

Xa`

_/`Xa`

b

X-`

_ `Xa`

b

À�MOUJw>?A= ÑR� o � bRp j>MODAMxBTa�DN?A=@=@P#BCPNPAHlg�MdBTDA=Q^6F#MODA< G tlMxgWtC=Q^�I>BTj\^3G t�MxgWtC=Q^6DN<>=�`>w\gWtJ=fD�I;�<>=3I>?N=@^_Mxg�BTDA=�BCPNPAHlg�MdBTDA=Q^�F#MODA< 5 � B�� � >�� MxP���pFl���Ã�; ´�M�o =Cod��<>MmD6`lnºS�HlHCDWµ8�BTjK^6BCPNPLH_g�MdBTDA=@^kF#MODA< 5 � B�� � >���� G��� � >I: MxP-DN<>=�I>?N=@^>Mdg@BiDA=�;�pGÃ�o�¥�UJBCMOj��JDA<\=�adHlg@BTadMmDGnI>?NHCI:=�?ADGnZMdP�PABTDAMxPG³\=Q^�F#MODA< DN<>=@PA=%PGDN?AwKg8DAw\?A=QP�ol]HCjKPLMx^_=�?EDN<>=%PL=@j�DA=�jKgf=Yb$�%'&)('*,+��E4����5&�����%'& (������'&�� 9

Page 156: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��r� �������� ������������� � ����������������! " #����$%$%���

pqDNP�^_=�?NMO�J=@^6DA?N=�=�MxP�UCMd�C=�j Mdj3À�MdUCw>?N= Ñ2� o q>o

Y�Z3[

Y� �� UrSS?TfU

XW� M �� U �

_ Xa`

SRT�U

XW

_/`Xa`

b

À[MdUCw\?A= Ñ2� o q>b ;�=@?AMd�C=Q^6DN?A=@=�S�HJ? G DN<>=�`:Hin6tlMdgWtJ=@^�DA<>=�`>wKgWtC=fD�I�(HiFE=��J=�?Q�\DN<>=�?N=YBT?N=%DGFEH�I:HJPNPLMd`>ad=k^_=@?AMd�iBiDNMOHJj\P�b�HCj>=�S�?AHJX 5 � B�� � >�� BTjK^�DA<\=HTDN<>=�?�S�?NHCX 5 � B�� � >���� G��� � >I: o�;�<>=�^_=@?AMd�C=Q^�PLDA?Nw\g8DNw>?N=C�lDA<\=�?N=fS�HC?N=C�>^>H�=QP�j>HTD#XZBTtJ==fe_I>adMxgfMOD#DA<>=%^_=@?AMd�iBiDNMOHJj�o;�<>=@?A=�MdP�BTj\HTDA<\=�?�PGDN?Aw\gfDAw>?N=�g@BTadaO=Q^ZDN<>=�^_=�?NMO�iBTDAMdHCjZDN?A=@=�F#<>MxgW<�MxPEXYHC?N=(S�w>j10^>BCXk=@j�DNBTaÎocpqD�PA<>HiF(P�^_=�?NMd�~BTDAMdHCj\P[DNH¦`:=#I:=�?AS�HC?NXk=Q^�DNH¦HJ`_DNBCMOj�DA<>=(^>=�?NMO�J=@^�PLDA?Nw\g 0DAw\?A=JokÀ\HC?�=fe>BTXYI>ad=C��S�HC?¦DA<>=ZPA=�j�DA=@j\gf= G DA<>=Y`:Hin¼tlMdgWtJ=@^¼DA<>=Y`>w\gWtJ=fD�IKDN<>=�?N=ZBT?N=DGFEHY^>=�?NMO�iBiDNMOHJj�DN?A=@=@P#PA<>HiF#j MOj�À�MOUJw>?N= ÑR� o o>o

o o o o o o o o o o o o

ooooooooooo

5 � B�� � >����NG�� � >I:5 � B�� � >��

5�G��� � >I: ´Pd?� dJµ5�GIHKJ ´ Ñ µ

5;:=<?> ´ Ñ µ

5fGIHFJ ´ Ñ µ

5A:=<?> ´ Ñ µ5;:=<?> ´ Ñ µÀ�MdUCw>?N= Ñ2� o o\b�;�=�?NMd�~BTDAMdHCj�DA?N=�=QPES�HC? G DA<>=�`:Hin6tlMdgWtJ=@^�DA<>=�`\w\gWtC=�D,I

p j¼B�^>=�?NMO�iBiDNMOHJj3DA?N=�=J�:BZad=@BTS�j>H_^_=�^¼MdP¦B6gW<>Mdad^¼HTS�BZj>H_^_=kg6´�g�HCj>j\=@g8DN=@^�`ln^_HCDLDA=Q^6adMOj\=�BT?Wg@µ�MmS�^ZMdP�PAw>`\PLDAMODAw_DN=@^�MOj gTo-;�<>=�BJ^>^_?N=@PNP�I�MOj�g�F#<>=@?A=¦^ZMdP�DAHk`:=PAw>`\PLDAMODAw_DN=@^�DAHZHJ`_DNBCMOj3^_=�?NMd�C=@^�DA?N=�=�MxP(PA<>HiF#j�Mdj3I\BT?N=�j�DN<>=@PA=@PEj>=�e�D#DNHZ^�b

Page 157: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� �3���; ��������� ���N � ���� � ��� ����������� � #����$%$%�� �� q

��� ��

p j3UC=@j>=�?WBTaÎ�_MmS-^��\BZgW<\MOax^ HTS-B�j\Hl^>=%gT�>MxP(Bkj>HCj30Îad=@BTS�j>H_^_=�Mdj¼BY^_=�?NMO�iBTDAMdHCj�DA?N=�=C�DA<\=�j�³\?WPLD�B6^_=@?AMd�C=Q^�DN?A=@=%MxP(HC`>DNBTMdj>=Q^ S�HC?(DN<>=%DN?A=@=%?NH�HCDA=Q^ BTD�^¼BCj\^ DA<>=@j¼MOD�MdPPAw>`\PLDAMODAw_DN=@^ MOj�g�BJP�`K=�S�HC?N=Co;�<lw\P@�>UCMd�C=@j BZ^_=@?AMd�iBiDNMOHJj�DN?A=@=C�_DN<>=�^_=@?AMd�C=Q^�DA?N=�=%g�BCj3`K=�HJ`_DNBCMOj>=Q^ `�n�IK=@?K0S�HC?NXYMOj\U¿DN<>=�PLw>`KPGDNMmDNw_DAMdHCj\PYMdjrB»`:HTDADAHJX w>IvXYBCj>j>=@?YPLDNBC?LDNMOj\U¿S�?NHCX DN<>=3aO=QBiSj>H_^_=QP�o �(HiFE=��C=@?@��DA<>=@?A=�MxP6j\Hº?A=QBTa#j>=@=@^vDAHºHJ`_DNBCMOjvDN<>=¿^_=@?AMd�C=Q^�DN?A=@=Co ;�<\=XY=@BCj>MOj\UZHTS�BZPL=@j�DA=�jKgf=%g�BCj�`K=�gfHCjKPGDN?Aw\gfDA=Q^�S�?NHCX DA<>=�^_=�?NMO�iBTDAMdHCj3DA?N=�=�´�PWµ8o�À>HJ?=fe>BCXkI\aO=J��PL=@XYBCj�DAMxg6HC`>ÏG=@g8DWP�g�HC?N?A=QPLI:HCj\^>MOj>U¼DAH¼DN<>=3BTX�`\MOUJw>HCw\P�PL=@j�DA=�jKgf= G DA<\=`:HinZt�MxgWtC=Q^ZDN<>=�`>w\gWtC=�D,I_g�BCj�`:=�gfHCjKPGDN?Aw\gfDA=Q^6S�?NHCX DN<>=¦DGF]HY^_=�?NMd�~BTDAMdHCj�DA?N=�=@PEMdjÀ�MOUJw>?N= ÑR� o o>o�(=@?A=�MdPkB¼PNBTXYI>ad=�gfHJj\PLDA?Nw\g8DNMOHJjºHTS#DA<\=�PA=�XZBTj�DAMxg6HJ`_ÏG=@gfD@o 5 � B�� � >�� <KBCP�BCjBCPNPAHlg�MdBTDA=Q^�PA=�XZBTj�DAMxg�S�HC?NXÆBJP#PL<>HiF#jcb

��pFl���Ã�;�´ Ñ � d>o dJµpqDkPNB~n_P�DN<\BiD�DA<>=�I>?A=Q^_Mxg�BiDN=�MxP ��pFl���à ;���MmDWP�PA=@g�HCj\^ºBC?AUJw>XY=�j�D�MxP�F#<KBiD�UJ=fDWPPAw>`\PLDAMODAw_DN=@^6BTD�BC^>^_?N=@PNP�d>o d>�CBTj\^ZPAH�HCjkS�HJ?�³\?WPGD�BC?AUJw>XY=�j�D@o-¾lMdXYMOaxBT?NaOnJ� 5�GIHKJ <\BJPDA<\=]PA=�XZBTj�DAMxgRS�HJ?AX�Ê����k�@BTjK^ 5fG�� � >I: <\BJP�DN<>=]PA=�XZBTj�DNMdgRS�HJ?AX�Ê���l���Ã];�o@À>?NHCXDA<\=�³\?WPLD¦^_=@?AMd�iBiDAMdHCj3DN?A=@=�FE=�UJ=fDk´�`ln3PAw>`\PLDAMODAw>DAMdj>U BTD Ñ BTj\^ d>o dZMOj.G ��pFl���à ;´ Ñ � d_oedCµ�µfb

��pFl���à ;�´�Ê����k�>Ê���l���Ã�;(µ´ ��=�?N=C� 5A:=<?> BTjK^ 5�7 <\B~�C=]`K=@=�j�MOUJj>HC?N=@^�S�HJ?-PLMdXYI>aOMxgfMODGnCo µ%;�<\=EPA=�XZBTj�DNMdg�S�HC?NX BCPK0PAHlg�MdBTDA=Q^%F#MODA< 5�� B�� � >����NG�� � >I: MdP ;�pGÃ�´ Ñ µ�BTjK^%DN<>=(PL=QgfHJj\^�^_=@?AMd�iBiDNMOHJj�DN?A=@=]nlMd=�ax^>P�b

;�pGÃ�´�Ê�����µ8o������ ����� ��!#"%$���&#�(' (s+-�(�� ' �[5���2��@2�� ),+-"%.�./"�+;(¾>Á MdP�j>HCD(IKHiFE=�?AS�w>aV=�j\HCw>UJ<�DNH�<\BCj\^_ad=�DA<>=�PAHkg@BTadaO=Q^ G F#<10qXYHi�C=�XY=@jJD�IlMOj�Ã�j30UCadMxPL<�o�À>HJ?[DN<>MxP[I\w>?AI:HJPA=C�iFE=�F#Mdada�j\=�=@^%DAH�BTw>UJXY=�j�DR;(¾\ÁrF#MmDN<�BJ^>^_MODAMdHCj\BCalPLDA?Nw\g 0DAw\?A=QP�BTjK^YHCI:=�?WBiDAMdHCjco�;�<>=�BTw>UJXk=@j�DA=@^YUJ?NBCXYXYBC?�MxP�;[?A=@=�¥�^~ÏGHJMOj\MOj>UkÁ¦?NBCXkXZBC?´�;�¥(Á�µ8o

Page 158: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�� o �������� ������������� � ����������������! " #����$%$%���

;�¥(Á g�HCj\PAMdPLDNPYHCS¦Mdj>MODAMxBTa#DN?A=@=@PZBCj\^rBTw_e_MdaOMxBT?Nn½DA?N=�=QP���BTj\^sDGFEH½HCI:=�?WBiDAMdHCjKPPAw>`\PLDAMODAw_DNMOHJj�BTj\^ºBJ^~ÏGHCMdj>Mdj>U�´�HJ?�BC^~ÏGw\j\g8DNMOHJjKµ8o3p j>MODAMxBTa�DA?N=�=@P�BTj\^ºPAw>`\PLDAMODAw_DNMOHJjHCI:=�?WBiDNMOHJj¼<\B~�J=�BTad?N=@BC^>n `:=�=@ju^>=f³\j>=Q^¿BJP�IKBT?AD¦HCS];(¾>Áko����C©Jª¬§¯ª ®i¹ Í�DA?N=�=QP�<\B~�J=ad=@BiS-j>H_^_=QP�axBT`:=�adad=@^3`ln�DN=�?NXYMOj\BCa[PAnlX�`:HCaxP�BTjK^3j>HCj�DA=@?AXYMdj\BTa�PLnlX�`KHJadP2cK=�e>BCg8DNaOnHCj\=�HCS�DA<\= ad=@BTS�j>H_^_=QPYF#MmDN<vB»j>HJj10�DN=�?NXYMOj\BCa�adBC`K=@a(PABCXk=�BJP�DN<>=3?AHlHCDkHCS�DA<\=BTw>elMdadMdBC?An�DA?N=�=�MdP]DA<\=�� ¸Q¸ Ì ¶V¸ ±J¨¦´�XZBT?NtC=Q^Z`ln G�� I µ�BCj\^�BCaOa:HTDN<>=�?Ead=@BiS�j\Hl^>=@PEF#MmDN<j>HJj10�DN=�?NXYMOj\BCa�adBC`K=@adP�BT?N=�PLw>`KPGDNMmDNw_DAMdHCj�j>H_^_=QP%´�XZBC?AtJ=@^�`�n3G � I µfo�pqS-=��J=�?Nn�BTw>elMda 0MxBT?Nn�DN?A=@= ´�`K=QPLMx^_=QP�Mdj>MODAMxBTa�DA?N=�=QPNµ�<\BJP¦BTD¦ad=@BJPGD¦HCj>=kad=fe_Mdg@BTa�MmDN=�X ´�M�o =Cod�VDA=@?AXYMdj\BTaPAn�X�`KHJaxµEBTD�B�ad=@BTS�j\Hl^>=C�lDA<\=�UC?WBTXYXZBT?�MdP#g@BTadaO=Q^ aO=�elMxg�BCaOMxPA=@^�;�¥(Áko¥�^iÏGHCMdj>MOj\UºHCI:=�?WBiDAMdHCjsDNBCtC=QPkBuDN?A=@=¼BTj\^vBTjËBCw_e_MOadMdBC?An½DN?A=@=¼BTj\^vI:=�?AS�HC?NXZPBTj½HJIK=@?NBTDAMdHCjºBCP�PA<>HiF#j½MOj�À�MdUCw>?N= Ñ2� o_o�p j½HTDN<>=�?%FEHC?W^>P@��DN<>=6BTw_e_MdaOMxBT?Nn�DN?A=@=

���������������������

O U \ Q S M ��L S O U�U

V �� M QPMIV�O [ S O U�US O UrU

À�MOUJw>?A= ÑR� o�lb#´�B�µ�|�Mxg8DAHJ?AMxBTaV?N=�j\^>=�?NMOj>UkHTS-BC^iÏGHCMdj>MOj\UkHJIK=@?NBTDAMdHCjBiD6B»j>HCj30�DN=�?NXkMdj\BCaEj\Hl^>= MxPkMOjKPL=@?LDN=@^sMOjsDA<>= DN?A=@=CosÀ\HC?Y=fe>BCXkI\aO=J��MOS�FE=�<\B~�J=

Page 159: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� �3���; ��������� ���N � ���� � ��� ����������� � #����$%$%�� Ñ�� BTj BTw_e_MdadBC?AnkDN?A=@=�S�HJ?�Geg�w>MxgWt�adn:I c_BJ^~ÏGHCMdj>Mdj>U�HJIK=@?NBTDAMdHCj�g@BTj�`K=�I:=�?AS�HC?NXk=Q^6HJj6DA<\=^_=@?AMd�C=Q^�DA?N=�=�S�HC? G �(=�PAIKHJtC=5IQ?N=@PAw>amDNMOj\U�Mdj�B#DN?A=@=�S�HC? G �(=�PLI:HCtJ=�g�w>MdgWtladn:IQBJP[PA<>HiF#jMdj3À�MdUCw>?N= Ñ2� o Ä\o

��� �?B�� � E J

b

b

� M �� Q [

V ���

� O Z

� M �� Q [

V ���b

b

\ � Z � U

_

TfU

_/`Xa`

b

\ � Z � U

_

T�U

` O Z �

_ `X-`

À[MdUCw\?A=Ñ2� o>´�`KµE¥�^_=@?AMd�C=Q^6DN?A=@=�BCj\^3BiS¬DN=�?(BC^iÏGHCMdj>MOj\UkF#MODA< ��� �?B�� � E J� �J�R�����@���K� �����Q�K���[����� ������¡i�_�@���K�-£~¤E;cH�IK=@?LS�HJ?AX�BJ^~ÏGHCMdj>Mdj>U�HJIK=@?NBTDAMdHCjHCj¼BZDA?N=�=%D�BiD�BJ^>^_?N=@PNP#I¼w\PAMdj>U�BYDN?A=@=%w¼F#MODA<¿BYS�HlHCDAj>H_^_= ´�PA=�=�À�MdU\o ÑR� o�_´�B�µLµf�?N=�XYHi�C=kDA<\=�PLw\`_DA?N=�=6P�HTSED�?AHlHCDA=@^½BTD�IºaO=QB~�lMOj>U�B�g�HCIln¿HCSEDN<>=6?NHlHTD%j>H_^_=6BTDI���PAw>`\PLDAMODAw>DA=3wsF#MODA<zDA<>=3j>H_^_=3BiDZBC^\^_?A=QPAP�IsMdj�DQ�]BCj\^º³\jKBTadaOnºPAw>`\PLDAMODAw_DN=3PBiD#DN<>=�S�HlHTDNj>H_^_=%HCSRwcoE¥�^~ÏGHCMdj>Mdj>UZMdP�^_MxPABCaOadHiF]=Q^�MOS-j>H_^_=�BTD�BC^>^_?N=@PNP�I�Mdj3D�MdP�BPAw>`\PLDAMODAw_DNMOHJjkj\Hl^>=CoR¥(axPLH�gfad=@BC?AadnC�~DN<>MxPRHCI:=�?WBiDAMdHCjkg�BCj�`:=(g�BC?A?NMO=Q^�HCw>DRHJj>adn%MmS:DA<\=

Page 160: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ�� Ä �������� ������������� � ����������������! " #����$%$%���

S

��� �

À[MdUCw\?A= Ñ2� o Ä\b�¥�?Ng�Mdj�^_=�?NMd�~BTDAMdHCj�DA?N=�=axBT`:=�aVHTS�DN<>=�j\Hl^>=¦BTDEBC^\^_?A=QPAP]I�MdjZD�MdP]DN<>=¦PNBTXY=¦BCP�DA<>=¦adBC`K=@aVHTS�DA<\=�?NHlHTD]j\Hl^>=HTS(wco¿;�<>=�BJ^~ÏGHCMdj>Mdj>U¼HJIK=@?NBTDAMdHCj�g�BCjº`K= PL<\HiF#jº`�n½BTjsBT?WgZMOj�DA<>= ^_=�?NMO�iBTDAMdHCjDA?N=�=�MOj»À[MdU\o Ñ2� o>´�`Kµfo�¥ ­W¸�jk §d¨fÌ ¨W± Ì ¹ ¨W¨�MdP�j>HiF�^_=�³\j>=@^¿BCP(HJj>=�F#<\MdgW<¼<KBCP(j\HPAw>`\PLDAMODAw_DNMOHJj»j>H_^_=Jo�;�<lw\P@��BTjuBTw_e_MdaOMxBT?Nn DA?N=�=kF#MmDN<»j>H�PAw>`\PLDAMODAw_DNMOHJj»j\Hl^>=�MxP�BgfHJXYI>aO=�DA=Q^6DN?A=@=Y´�=��J=�j�DA<>HJw>UC< MmD(^_Hl=QP�<\B~�C=�B�j\HCj10ÎDA=@?AXYMdj\BTa�BiD#MODNP�S�HlHCD�j\Hl^>=Qµ8o� �J�R�����@���K���G� ��¡i�! K�l� "]¡i�l�_£i¤#¥ ^>=�?NMO�J=@^�DA?N=�=�MxP#BTjln6HTS[DA<>=�S�HJaOadHiF#Mdj>U\bÑ o(¥(j3MOj\MmDNMdBCaVDA?N=�=�HC?#BCj3BCw_e_MOadMxBT?NnYDA?N=�=Cod>o(¥�DA?N=�=�HJ`_DNBCMOj>=Q^3`ln�PAw>`\PLDAMODAw_DNMOj>U�B6gfHJXkI\aO=�DA=@^�^>=�?NMO�J=@^�DA?N=�=6´�F#MmDN<>HCw_D¦BS�H�HCDAj>H_^_=~µ]MOj�BTj3Mdj>MODAMxBTaVDA?N=�=JoÅ\o(¥ÂDA?N=�=ZHC`>DNBTMdj>=Q^»`lnuBC^~ÏGHJMOj>Mdj>U�B�gfHJXYI>aO=�DA=Q^u^>=�?NMO�J=@^»DA?N=�=�´�F#MODA<�B S�HlHCDj>H_^_=Qµ]Mdj3BZg�HCXYI>ad=fDN=@^ ^_=�?NMO�J=@^�DA?N=�=Jo¥�PRBCj�=�e_BCXYI>aO=J�TgfHJj\PLMx^_=@?[DN<>=#BTw_e_MdaOMxBT?Nn¦DA?N=�=QPcS�HJ?R?A=@adBTDAMd�C=]g�adBCw\PA=�S�HJ? G BiDN=5IiMdjÀ�MOUJw>?N= ÑR� o Ò>o[;�<\=]³K?NPLD-MdPRB¦?A=@adBTDAMd�C=�gfaxBTw\PA=EF#MmDN<kPAw>`_ÏG=Qg8D-?A=@adBTDAMd�lMOhQBiDAMdHCjkBTj\^�DA<\=PA=@gfHJj\^ MdP(F#MmDN<�HC`_ÏG=Qg8D(?N=�axBiDAMd�lMOhQBiDNMOHJj�o];�<>=%y�|Ë^_HCXYMdj\BiDNMOj\UYDA<>=%=@XYI_DGn PLDA?NMdj>U´��8µ�MOj\^>Mdg@BiDA=QP-DN<\BiD]DA<>=¦BT?NUCw>XY=�j�D�HCS�É MxP�j>HCD]MdjZMmDWP�I:HJPAMmDNMOHJj��lBTj\^6g�HCMdj\^_=�elMdj>U��BTjK^�F#<10 y�|u`ln%M�´�HC?�PA<>HiF#j�`ln%adMdj>tlMOj>U�`ln�^_HCDLDN=@^�aOMdj>=Qµ�Mdj\^_Mxg�BTDA=QP�DA<\BTD-DA<>=@n�BT?N=DA<\=�PABCXY=¦=@aO=@XY=�j�DNP@o];�<>=�?A=QPGD#HTSRDN<>=�DA?N=�=�MxP(BkS�BTXYMdaOMxBT?�^_=@g�adBC?NBTDAMd�C=�PGDN?AwKg8DAw\?A=JoÀ�MOUJw>?N= Ñ2� o ÑR� PL<\HiF(P�DA<\=�^_=@?AMd�C=Q^½DA?N=�=ZS�HJ? G ;�<>=�`KHin½F#<>H¿BTDA= B¼`\BCj\BTj\B¿PAB~FB½UCMd?Na IdoËpqD6MdP6HC`_DWBTMdj>=@^v`lnzPAw>`\PLDAMODAw_DNMOj>U 5f7 MOj 5�GI7��p7��p7 ��DN<>=�jrDN<>=�?A=QPLw\amD6Mdj

� C'>IE � 6 ��G�� �N7':=> o�;�<\MdP-g�HCXYI>ad=fDA=Q^�BCw_e_MOadMxBT?Nn�DN?A=@=�MdP-BJ^~ÏGHCMdj>=@^�Mdj < >¦´¬S�HJ?�G DN<>=�`KHin:I µBiD(BJ^>^_?N=@PNP � �_F#<>MxgW<�MxPEDA<>=@j�PLw>`KPGDNMmDNw_DA=Q^�Mdj 5�� � �9>�� E o-;�<>=�³\j\BCa�?A=QPLw>aODNBCj�D]DN?A=@=MxP#g�BTadad=@^ <Co;�<>=�^_=@?AMd�iBiDAMdHCj�DA?N=�=QPES�HC?�< D BTj\^ <��BT?N=¦UJMO�J=�j MOj�À�MdUCw>?N= Ñ2� o ÑCÑ opqD PA<>HJw>ad^ `K=u=�XYI><\BJPLMdh�=Q^rDA<KBiD�DN<>=½BTw_e_MdaOMxBT?NnzDN?A=@=@P�BT?N=¿ad=fe_Mdg@BTadMOh@=@^ËBCj\^<\B~�J=�aOH_g�BCaOMODGnCo�¥(w>elMdadMdBC?An�DA?N=�=@P(S�HC?(UJUC?N=�axBiDNMO�J=�g�adBCw\PA=�S�HC?��J=�?N` G BTDA=5IK<\B~�C=�`:HTDN<BT?NUCw\Xk=@j�DNPEHTS�DA<>=�I\?A=Q^_Mdg@BiDN=�S�HJ?(BiDN=¦Mdj DA<>=%PLDA?Nw\gfDAw>?N=Col]HCjKPLMx^_=�?�j>HiF BTj3BTw_e_MdaOMxBT?NnZDN?A=@=�S�HJ? G DN<>HCw\UC<�D,I_Mdj�À[MdUCw\?A= Ñ2� o Ñ d_o

Page 161: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� �3���; ��������� ���N � ���� � ��� ����������� � #����$%$%�� Ñ�� Ò

ooooooooo o oo¦o�o¦o

oooooooooooo o o o o o o o o o�o¦o�o¦o�o�o

4

4

44

� Y ��� Y�� U � S O U QIV S M � M���V S M Z �

_/`

b

� V � b �Y�� U � S O U Q V S M � M��^V S M Z �

� B

�� ] T�

� B

�� ] T�

_/`

b

b

V SRU

_

Xa` M

Xa` �

� C'>IE � HFG�� � 7':=>� C'>IE � 6 ��G�� �N7':=>

V SRU

_

Xa` M

Xa` �

Xa`

Xa`

Xa`

Xa`

Xa`

b

Xa`

À�MdUCw>?N= Ñ2� o Ò\bR¥�w_e_MOadMxBT?NnZDA?N=�=QPES�HC?#?N=�axBiDAMd�C=�gfaxBTwKPL=

Page 162: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ q � �������� ������������� � ����������������! " #����$%$%���

oooooooooooooo o o o o o oooo � B

V SRU

Y V ��V � VV

XW

LNMPORQV

XW\?V^]

Y�Z1[S?TfU

XW

Xa`

] T Z

� O Z �

� C'>IE � 6 ��G�� �N7':=>

Xa`

_

_/`

_/`

b

bX-` M

X-`

Xa`

b

Xa`

À�MOUJw>?N= ÑR� o Ñ2� b �#=QPLw\amD(HCS�BC^iÏGHCMdj>MOj\UYBCj BCw_e_MOadMxBT?NnZDA?N=�=�HCj < D

Page 163: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� �3���; ��������� ���N � ���� � ��� ����������� � #����$%$%�� Ñ q Ñ

o o o o o o o o o o o o

o o o o o o o o o o o o

ooooooooooo

o o o o o o o o o o o o

ooooooooooo

� Y ��� Z O <

� V ��� Z O < D

5 @9BDCKE ������� �

5 6 � �9>�� E �N6�7 8

5 :=<?> ��� � 5 7 �� �

5 GIHFJ �� � 5 @9BDCKE ������� �

5A:=<?> �� �

5 7 �� �

5 GIHFJ �� �

5�6 � �9>�� E �N6�7 8

� C >IE �N6 ��G�� �N7':=>

À[MdUCw\?A= Ñ2� o ÑJÑ b�;�=@?AMd�iBiDNMOHJj�DN?A=@=@PES�HC?�< D BTjK^ <�

Page 164: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ qrd �������� ������������� � ����������������! " #����$%$%���

4

� :=<?H �2@ <2:

b

� T Z L T S

b_

_ `Xa`

À[MdUCw\?A= Ñ2� o Ñ d_bR¥(w_e_MdaOMxBT?NnZDN?A=@=�S�HJ? G DN<>HCw\UC<�D,IdopqS � :=<RH �R@ <�: MxPRBC^~ÏGHJMOj\=@^%Mdj � C > E �N6 ��G�� �N79:=> BTDRBJ^>^_?N=@PNPfd>o d(`K=�S�HC?N=�MODRMxP�BC^~ÏGHJMOj>=Q^DAH < D BiD Ñ F]=(UJ=fD�DN<>=�^>=�?NMO�J=@^kDA?N=�= <���PL<>HiF#jZMdj�À�MdUCw>?N= Ñ2� o Ñ Å�S�HC?�DN<>=�PA=�j�DN=�j\g�=$�%'&)('*,+ 0 %5*��5/�� ��%'* �82�%�./ �8& / ('/��5/��5/ -�/10./ 25416'7:9

y(HCDA=�DA<\BTDZ=��C=@j�DN<>HCw>UJ< G F#<>H I-Mdj�<� <\BCPYBCI>I\BT?N=�j�DNaOn½XYHi�C=Q^zB~F�B~n¿S�?NHCX��F#<>=@jug�HCXYI\BC?A=Q^�F#MmDN< <C��DA<>MxP�<\BJP�`K=@=�j½BCgW<>Md=��J=@^¼F#MODA<\HCw_D%BTjln�XYHi�C=@XY=�j�D?Nw>aO=Jo¿;�<>=�aOHJj>U 0 ^_MxPGDWBTj\g�=�^_=�I:=�jK^_=�j\g�n½MdPkPLMdXYI>adn½B¿gfHCjKPL=RgJw\=�j\g�=6HTS(Mdj\PA=�?ADAMdj>UPAHCXY=�ad=fe_Mxg�BCaEMODA=@XZP�`ln�XY=QBTj\P�HTS�DA<>=�BC^iÏGHCMdj>MOj\U»HJIK=@?NBTDAMdHCj�o�;�<>= MdXkI:HC?ADNBCj�DI:HCMdjJD(MxP#DN<\BiD�BCw_e_MOadMxBT?NnZDA?N=�=QP�S�HC?�DN<>=%?N=�axBiDAMd�C=�g�adBCw\PL=�<KB~�C=�aOH_g@BTadMmDGnJ�\BTj\^ nJ=fD(MOD^_Hl=@P�j>HTD�B�:=Qg8D�adHCj>Up0q^_MxPLDNBTjKgf=#^_=�I:=�jK^_=�j\g�nVo[pqD]g@BTj�DA<lw\P�`K=(BC?AUJw>=@^�DA<\BTD�;[¥(Á�P<\B~�J=¦BCj =�elDA=�jK^_=@^3^_HJXYBCMOj HTS�aOH_g@BTadMmDGn6HCSKÏGwKPGD#DN<>=�?AMdUC<�D(BTXYHJw>j�D@o����� � �3�("¦7�,3+-� *Z7R+ ,3!E7�,3+-�(0À�MO?WPLD@��FE=k^>MdPNgfw\PNP¦<>HiF�S�=QBiDAw\?A=YPGDN?AwKg8DAw\?A=QP¦g@BTj»`K=Yw\PA=@^»F#MmDN<u;(¾\Á DAH <\BCj\^_ad=BTUJ?A=@=�XY=�j�DQo�{[BiDA=@?#F]=�F#MdaOac=felDA=@j\^�DA<>=�j>HCDAMdHCj�DAH6;�¥(Áko;[H�=fe_I>?N=@PNP�DA<\BTDEUJ=�j\^_=@?@��jlw>X�`:=�?#BCj\^ZI:=�?WPLHJj6=fDWgTo-HTScDA<>=¦�C=@?A`6X�w\PLD�BCUC?N=�=F#MODA<rDA<\=¿PLw\`_ÏG=@gfD�y�|R��FE=�MdjJDN?AH_^_wKgf=¼gfHJj\PLDA?WBTMdjJDWP�o ;�<>=@PA=¿BT?N=3=fe_I>?N=@PNPL=Q^z`lnPLDA?Nw\g8DNw>?A=QPYF#<>MxgW<sadHlHCt�adMOtJ= S�=@BiDNw>?N=3PLDA?Nw\gfDAw>?N=@Pk`>w_D6<KB~�C=3�iBT?NMdBC`>aO=QP�o > pqS¦DA<\=PNBTXY=%�iBT?NMdBC`>ad=%j\BTXY=�Hlg@gfw>?WP�BTD�DGFEH6I>axBCg�=@P@�KMOD�Mdj\^_Mxg�BTDA=@P�DA<KBiD�DN<>=YPABCXk=��~BCaOw\=X�wKPGD(H_g�g�w>?(BiD#`:HTDN< I\adBJgf=@P@oÀ�MOUJw>?N= ÑR� o Ñ�� PA<>HiF(P]DA<\=%BTUC?N=�=@XY=�j�D�g�HCj\PLDA?WBTMdj�DEHJj BCj�Mdj>MODAMxBTaVDN?A=@= 5 � � �9>�� E opqD�PAB~n_P�DA<\BTD�DN<>=Y�~BCaOw\=�HCS�DA<>=�S�=@BTDAw>?N=YBTUC?�BiD�É��Vɦ| BCj\^¿y�| MxP�DA<>=YPABCXY=kBJP

� ����������������������� ������� �!��"�#$��%�� &'�(�)"�& *��+����&',-".%����0/�� �+".#)&'��� ������� #.��1',-"�2435& ��%76��98:&'".;��+�-<= < >)<

Page 165: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� �3���� �����f�� � ���=��#��f�� � Ñ qCÅ

ooooooooooooooooooooooo o o o o o o o o oo�o%o�o%o�o%o%o�o

<�

� B� :=<?H �R@9<2:

_

\?V^]

V

S?T Z L T S� V��

] T Z

` O Z �

��� BY Z1[S?TfU

_X

W XXW

LNM O2QV

V S?U

_

W

Y V � V � V

X

Xa`

_/`

_/`

_/`

b

b

b

Xa`

Xa`

Xa`

Xa`

Xa`

b

À�MOUJw>?N= Ñ2� o Ñ Å>b[¥(S¬DA=@?EBJ^~ÏGHCMdj>Mdj>U � :=<RH �R@ <�: Mdj � C >IE �N6 ��G�� �N7':=> �_BTj\^YDN<>=�?N=@PAw>aOD]Mdj < DFE=¦UJ=fD < �

Page 166: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ q � �������� ������������� � ����������������! " #����$%$%���

���������������������� � � � � � � � � � � � � � � � � � � � �� � � � � � � � � � � � � � � � � � � � ���������������������� 4

4

� Z � U�� � U � QV�LNO � � � � � � Q

� Z � U�� � U � QV�LNO � � � � � \RL

� ��� 7'@9C�� �

� :� :

\ U�U

\ UrU \Xa`� V�LNO � � � :

� V�LNO � � X-`

5 6 � �9>�� Eb

À[MdUCw\?A= Ñ2� o Ñ2� bRÀ>=QBiDAw\?A=�gfHJj\PLDA?WBTMdjJDWP]S�HC?(BTUJ?A=@=�XY=�j�D�iBT?NMdBC`>ad=����lF#<>=@?A= � g@BTj�DNBTtJ=�BCj�nY�iBTadw>=Jo�´�y(HCDA=�DA<\BTD]DN<>=�Mdj>MODAMxBTa:DA?N=�= 5 � � �9>�� EMxP]BCj\gW<>HC?N=@^kHJj�B�DN?NBCj\PLMODAMd�C=��C=�?N`�oR;�<>=�BCj\gW<>HJ?�MxP�j>HCDEPA<>HiF#jZ=fe_I>adMxgfMODAadnk`\w_DEMODNPI>?N= 0ÎDA=@?AXYMdj\BTa�� : MxP¦XZBT?NtC=@^3`ln�B ^_MdBCXYHCj\^�o�;�<>=YBTj\gW<\HC?WPJG PL=@=@P,I:BCj\^ G PL=@=5IVBT?N=PA<>HiF#j¼PL=@I\BT?WBiDN=�adn�F#MODA<�� : BCP#?NHlHTD�j\Hl^>=�<\B~�lMdj>UYS�=@BTDAw>?N=�PAMOj>UJw>axBT?�BCj\^�I>adw>?WBTaÎ�?N=@PAIK=Qg8DAMd�C=@aOnJo�;�<\=(w\PA=�HTSVDN<>=�^_MxBTXYHJj\^YXZBT?Nt�^_Hl=@P�j>HTD�B�V=@gfD�DA<>=�IKHiFE=�?�HTS�DA<\=UC?WBTXYXZBT?�`>w>D(MdP�HJj>aOn�BZgfHCjl�J=�j>Md=�j\g�=¦^>=��lMdg�=Co µ

mË<>=@jvBuPLw\`\PGDNMmDNw_DAMdHCjvHCI:=�?WBiDNMOHJjzMxPkIK=@?LS�HJ?AXY=@^���DA<\=3PAw>`\PLDAMODAw>DAMdHCjrg�BTjv`:=I:=�?AS�HC?NXk=Q^¿HJj>adn¼MmSEDA<\=YS�=@BiDNw>?N=@P�w>j>MOS�nCo6;�<lw\P@�cMOS�F]=ZBiDADNBJgW<¿DN<>=YDA?N=�=kS�HC?�G PA=�=5IBiD�DA<>=�^>MdBCXkHJj\^ j>H_^_=�´�aOMdtC=%BZPAw>`\PLDAMODAw_DNMOHJj¼HCI:=�?WBiDNMOHJjKµ�DA<>=�S�=@BTDAw>?N=%PGDN?AwKg8DAw\?A=QPw>j>MOS�nC�KBTj\^���UC=�DNP�`:HCw>jK^�DNH\b����� ����� b �����

y(HiF��_MOSRF]=¦DA?Nn6DNHYUC=�j\=�?WBiDA=¦DN<>=%PL=@j�DA=�jKgf=Cb� � & -,& & / �E*"!54,& &"!8&�6 + �8/,+ 9

`ln�PAw>`\PLDAMODAw_DNMOj>UYDN<>=�S�HCadadHiF#MOj>UkDN?A=@=Cb#%$ & /12 6�'�& �����('�- 2%)%)*

+ 6'* �5* ���,& /12 6�'�& �����('�- 2%)%)*�%-

Mdj 5 � � �9>�� E BiD�BJ^>^_?N=@PNP Ñ ��DN<>=�PAw>`\PLDAMODAw_DNMOHJjuS�BTMdadP6´�HC?�MxP�`>adH_gWtC=@^Kµ�`:=@g@BTw\PA=YDA<\=w>j>MO³Kg@BiDAMdHCj HTS.��F#MODA<3�iBTadw>=/� jlw>X b-I>a0�cS�BTMdadP#F#MODA<�� jlw>X b�PAU1�Îop j3S�=@BTDAw>?N= 0q`\BJPL=Q^�;�¥(Á�P��\DGF]H6PLDA?Nw\gfDAw>?N=@P%´�g�BCaOad=@^ DNHCI¼BTjK^�`:HTDADAHJXZµ�BT?N=%BiDF0DNBJgW<>=@^�DAH�=QBCgW<�HCS_DA<>=]?AHlHTD�j>H_^_=]BCj\^�S�HlHTD�j>H_^_=�Mdj�BCj�BTw_e_MdaOMxBT?Nn(DN?A=@=CoR¾lMOXYMdadBC?AadnC�

Page 167: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^� �3���� �����f�� � ���=��#��f�� � Ñ qrqDGFEH»PLDA?Nw\g8DNw>?A=QP�BC?A= BiDADNBCgW<\=@^�BTDk=@�C=�?Nnuj>H_^_=�MdjsB¿DA?N=�= BiDYF#<>MxgW<sBC^iÏGw>j\g8DNMOHJjXYMOUJ<�D�DNBCtC=»I>adBJgf=Jo}À�MOUJw>?N= Ñ2� o Ñ q½PL<\HiF(P6<>HiF BJ^~ÏGw>j\gfDAMdHCj BCj\^ PAw>`\PLDAMODAw_DNMOHJjB�V=@gfD#DA<>=%PLDA?Nw\gfDAw>?N=@P@o

o�o�o�o�o�oo¦o�o�o�o�o�oooo o o oo o o

o�o�o�o�o�oo o o o oo

o o o o oo o o o o oo o o

oo o o o o oo o oo o o o o oooo o oo o o

o o o o oo o o o oo o ooo�o�o�o

o o o o oo�o�oo o o o o o

o%o�o%o�oo o oo o o ooo o o o o

�������������

4�

4

�������������

���������������������

�� C� C

����� C� C

S

� � ���

� �

� C

����� C

��� �

� C� C

YS

�� C� C

����� C� C

S

À�MOUJw>?N= Ñ2� o Ñ q_b»¾�DN?AwKg8DAw\?A=QP�BiS¬DN=�? BC^~ÏGHJMOj>Mdj>UzBCj\^ËPAw>`\PLDAMODAw_DNMOHJj HCI:=�?WBiDNMOHJj\P¼´ �PLDNBTjK^>PES�HC?#w>j\Mm³Kg@BiDNMOHJjKµy(HCDA=3DN<\BiD�BCjrBJ^~ÏGHCMdj>Mdj>U½HCI:=�?WBiDNMOHJjsXZB~nz`:=�I:=�?AS�HC?NXk=Q^rBiD�BTjËBJ^~ÏGHCMdj>Mdj>Uj>H_^_=�MOS[MODNP]DAHJI PLDA?Nw\g8DNw>?N= � w>j>MO³\=@P�F#MODA<�DA<>=¦DNHCI�PLDA?Nw\gfDAw>?N= � C HCS�DA<>=�?NHlHTD@�_BCj\^`:HTDLDNHCX1PGDN?Aw\gfDAw>?N= � w\j>Mm³K=@P#F#MODA< DA<\=�`KHCDLDAHJXÆPLDA?Nw\g8DNw>?N= � � HTS�DA<>=�S�HlHTD(j\Hl^>=CoÀ�MOjKBTadaOnJ�TBiS¬DA=@?cDN<>=�^_=�?NMO�J=@^�DN?A=@=�MxP�HC`_DWBTMdj>=@^��~DN<>=]DAHCI�BTj\^�`KHCDLDAHJX PGDN?AwKg8DAw\?A=QPBiD%=@�C=@?An¼j\Hl^>=6BT?N=kw\j>Mm³K=@^�o pqSEw\j>Mm³:g�BiDNMOHJjuS�BTMdadP%BTD�B j>H_^_=C�[DA<\=�^_=�?NMd�~BTDAMdHCjuMdP?N=GÏG=@gfDA=Q^�o�À>w\?LDN<>=�?�BJ^~ÏGw>j\gfDAMdHCjc´�PNµ�XYB~n¿`K=ZI:=�?AS�HC?NXY=@^½BiD�DN<>=Zj>H_^_=@P�BiD%F#<>MxgW<

Page 168: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ qpo �������� ������������� � ����������������! " #����$%$%���

w>j>MO³Kg@BiDAMdHCj6S�BTMdaO=Q^��Jad=@BJ^_Mdj>U�DAHkB%j>=@FË^_=�?NMO�J=@^kDN?A=@=Co-;�<>=�w\j>Mm³:g�BiDNMOHJj6HTSVDNHCI�BCj\^`:HTDLDNHCX PLDA?Nw\g8DNw>?A=QP#FEHCw>ax^3`K=�g�BT?N?NMO=Q^�HJw_D(DNH�gW<>=QgWt�F#<>=�DA<>=@?(DA<\=�j>=@F�^>=�?NMO�J=@^DA?N=�=�MxP(BCg@gf=@IK=QBT`>ad=Co¥�P3BCj =fe>BCXkI\aO=J��gfHJj\PAMd^_=@? BCUC?N=�=@Xk=@j�D�`:=fDGFE=�=�j BTUJ?�HCS�PLw\`_ÏG=@gfD3y�|ÆBCj\^É�|R�RBTjK^�XYH_^>BTadMmDGn½F#<>=@jsBJ^~ÏGHCMdj>Mdj>U¿HJIK=@?NBTDAMdHCjºMxP�I>?N=@PA=�j�DQo»p jvÀ[MdUCw\?A= Ñ2� o Ñ o\��iBT?NMdBC`>ad=@P�m�� ��� ���cBCj\^���BJP��~BCaOw\=@P�HCS�S�=@BTDAw>?N=@P@�[PAI:=@gfMOS�n¿g�HCj\PLDA?WBTMdj�DNP@oYy�HTDN=

���������������������� � � � � � � � � � � � � � � � � � � � �� � � � � � � � � � � � � � � � � � � � ���������������������� 4

4

V�LNO ���� Z � U ��� � Z � U����

� V�L�O � �

� Z � U����V�LNO � �

_/`

V LNO ��� _ Xa`

� V�LNO � � X-`

b

À[MdUCw\?A= Ñ2� o Ñ o>bRÀ>=QBiDAw\?A=�gfHJj\PLDA?WBTMdjJDWPES�HC?(BCUC?N=�=�XY=@jJD#BTjK^�XYH_^>BTadMODGnDA<KBiD(BiD�j>H_^_=�É�|sDA<\=¦�iBCaOw>=¦HTSRBTUJ?]Mdj�`:HTDADAHJX PGDN?AwKg8DAw\?A=�BTj\^6DAHJI PLDA?Nw\g8DNw>?N=C�lMdPm BCj\^ ����?A=QPLI:=@gfDAMd�C=@aOn3`:=@g�BCw\PA=kBJ^~ÏGw>j\gfDAMdHCj»BTD�É�| j>H_^_=�XZB~n�UJMO�J=�^_M :=@?A=@j�D�iBTadw>=@PEDNH m BCj\^ ��o;[HkUJ=�j>=@?NBTDA=�DA<>=%PA=�j�DN=�j\g�=

$�%'&)('*,+ ��* �'7��.-,& & /)25416'7 9

DA<\=EBCw_e_MOadMdBC?An¦DN?A=@=�S�HJ? � � H��RE � j>=@=@^>P[DNH�`:=#BC^~ÏGHJMOj>=Q^�DNH � > ?A=QPLw\amDNMOj>U¦Mdj � @ ´�À�MOUJw>?N=Ñ2� o Ñ TµfoÂp j3DN?A=@= � @T�:PLMdj\gf=�DN<>=�³\jKBTacPLDA?Nw\g8DNw>?N=�<\BCP�`:=�=@j�?A=QBCgW<>=Q^��lDA<>=%DAHCI�BCj\^`:HTDLDNHCX PLDA?Nw\g8DNw>?N=@P%Mdj�=QBCgW<�HCS#DA<>= É�|Ðj>H_^_=�BC?A=6w\j>Mm³K=@^�o½y(HCDA=�DA<\BTD�Mdj�DA<\=³\j\BCa\PLDA?Nw\g8DNw>?A=J�TDN<>=#DGFEH¦É¦|ºj>H_^_=QP-<\B~�C=#^_M V=�?N=�j�D�jlw>X�`:=�?EBTj\^kXYH_^>BTadMmDGnJo�;�<\=adHiF]=@?#É�|Ëj>H_^_=�UC=fDWP#MODNP��~BCaOw\=�S�?AHJX G PL=@=5IKF#<>MOad=�DN<>=%<>MdUC<>=@?(HCj\=%UC=�DNP#MODNP��~BCaOw\=S�?NHCX G gfHJw>ad^ IOo����� *�5�. ��� "¦7� 3��./"¦7-�f!#"%$ 0��u�(!E7�0mu=%<\B~�C=�=@XkI\<\BCPAMOh@=@^�DA<\=�j>HTDNMOHJj\P#HTSRad=fe_Mdg@BTadMOhQBiDNMOHJj BCj\^ aOH_g�BCaOMODGnCoE¾lHCXY=�?N=@BC^10=�?WP-XYMdUC<�D�FEHCj\^_=@?�F#<>=�DA<>=@?]B�UCMd�C=@j lEÀ[Á�Á Ñ g�BCjY`K=�?A=@I>adBJgf=Q^�`lnkB�aO=�e_Mdg@BTadMOh@=@^lEÀ[Áko>Á Ñ g�BTj BTadFEB~n_P�`K=�gfHJj��J=�?ADA=Q^kDAHYB%FE=@BTtladnY=2g�w>Md�~BCaO=@j�D]ad=fe_Mdg@BTadMOh@=@^�UC?WBTX 0XZBT?�Á d¼´�MdjuÁ¦?N=�Md`\BJgW<¼y(HC?NXZBTa�À>HC?NX6µ8�:<>HiFE=��C=@?@�\DA<>=@?A=�XkMdUC<�D¦`K=kj>H�PLDA?NHCj>UJaOn=2g�w>Md�iBTad=�j�D�aO=�e_Mdg@BTadMOh@=@^ lEÀ[Á ´Î¾_gW<\BC`K=QP�� Ñ ÒCÒ � µfo�¥�P�B�?N=@PAw>aOD@��DN<>=ZI\BC?NPA=kPLDA?Nw\g 0DAw\?A=QPES�HC?(PA=�j�DA=@j\gf=QP�F]HJw>ad^�`:=@gfHJXY=%^_M V=�?N=�j�D�BCj\^�adMdj>UCw>MxPLDAMxg�BTadadn6w>j>XYHTDNMO�iBTDA=@^�o

Page 169: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^���^�.� � $% �$%������ �$%���f������� ���3� ��#� � Ñ q

o¦o�o¦o�o¦o�oo o oo o oo

o o o o o oo o o o oo

� V�LNO � � � � � \2L

V�LNO � � � � � \RL

� Z � U�� � U � QV�LNO � � � � � � Q

� Z � U�� �

� V�LNO � � � � � � Q

� � H��RE �

� Z Q �

_

� � Z � U�� � U � Q

_/`�

� � Z � U�� V Y M QPM S [ _/`

\ UrU

_S?TfU Y�Z1[

V LNM O2Q

X-`

_/`Xa`

b� >

À�MdUCw>?N= Ñ2� o Ñ Z´�B�µ8b]¾_HCXY=�MOj>MODAMxBTa[BTj\^ BTw_e_MdaOMxBT?NnYDA?N=�=QP�F#MmDN< S�=@BiDNw>?N=%gfHCjKPGDN?NBCMOj�DNP

Page 170: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ qCÄ �������� ������������� � ����������������! " #����$%$%���

o o o o o oo o oo

o o o o o oo o oo o oo o

\ UrU

� Z � U�� V Y M QPM S [� @ V�L�O � � � � � \2L

� Z � U � � U � QV�L�O � � � � � � Q � Z Q �

_

_/`_SRT�U Y Z1[

V LNM O2Q

X-`

_ `Xa`

b

À[MdUCw\?A= Ñ2� o Ñ 6´�`Kµ8b�;�<\=�³\j\BTa�^>=�?NMO�J=@^�DA?N=�= � @�`ln�BC^iÏGHCMdj>MOj\U � � H��RE � MOj � >

À�MdUCw>?N= Ñ2� o Ñ _b�¥�^~ÏGHCMdj>Mdj>UZF#MODA< S�=@BTDAw>?N=�gfHCjKPGDN?NBCMOj�DNP

Page 171: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^���^�.� � $% �$%������ �$%���f������� ���3� ��#� � Ñ qCÒp j�g@BCPA=�HCSK;[¥(Á�P@�TMOD-<\BCP[`K=@=�jYPL<\HiF#j%DA<KBiD-B�PLDA?NHCj>UJaOn�=RgJw\MO�iBTad=�j�DRaO=�e_Mdg@BTadMOh@=@^;�¥(Á�=fe_MxPGDWPES�HC?#BTjlnZUJMO�J=�j�;�¥(Á�UJ?NBCXYXYBC?@oR;�<lw\P@�_aO=�elMxg�BCaOMdh�=Q^�;�¥(Á�P�<\B~�C=�DA<\=PNBTXY=�IKHiFE=�?#BCP#;�¥(Á�P@o;�¥(Á�P�BT?N=6XYHC?N=6I:HiF]=@?LS�w\a�DA<KBTj lEÀ�Á�P�o»pqD�MxP�tlj>HiF#j½DN<\BiD lEÀ[Á�Pk^_H¼j>HCD<\B~�J=%BC^_=RgJwKBiDA=�IKHiFE=�?#DNH6<\BCj\^_ad=�PLHJXY=%j\BiDNw>?WBTa�axBTj>UJw\BTUJ=�I><>=@j>HCXY=�jKB>o#;[¥(Á�P^_=�³\j>=ºBsg�adBJPAP�HTS�adBCj>UCw\BCUC=QP�g@BTadaO=Q^ XYMOax^_adn gfHJjJDN=felD�PL=@j\PLMODAMd�C=u`:=@g�BCw\PA=¿DN<>=�nS�BTada-Mdj10Î`:=fDGFE=�=@j lEÀ�Á�BTj\^ l]HCj�DN=felD�¾_=�j\PAMmDNMO�J=YÁ¦?WBTXYXZBT?Y´ l�¾\Á�µ8o�pqD�<\BJP�`:=�=@jS�HC?Wgf=�S�w>adaOn�BC?AUJw>=@^%DA<\BTD�;[¥(Á�PR<\B~�J=cÏGwKPGD-DN<>=#?AMdUC<�D-BTXYHCw\jJD-HCSKI:HiF]=@?[DNH�g�BTI>DAw>?N=BTjK^»=�e_I>adBCMOj½axBTj>UJw\BTUJ=�I\<>=�j>HJXY=�j\B\o ;�w>DNgW<½UCU�gf?NHJPNP¦PA=�?NMxBTa�^_=@IK=@j\^_=�jKgfMd=@P@�cS�HJ?=fe>BCXkI\aO=J�>g�BTj `:=�<\BTj\^>aO=Q^�`ln6MOD@o��HJ?A=@Hi�C=�?Q�V;[¥(Á�P�<\B~�J=�BCj»=�e�DN=�j\^>=@^u^_HCXZBTMdj¿HCS]adH_g�BTadMODGn�F#<>=�j½gfHJXkIKBT?N=@^DAH¦HTDN<>=�?�S�?WBTXY=�FEHC?Nt_P�<\B~�lMdj>U�UJ?A=QBiDN=�?cI:HiFE=�?#´�=Jo UK�T{cÀ[Á�µfoT{�HJj>U�^_MxPLDNBTjKgf=�^_=�I:=�j10^_=@j\gfMd=@P]HTS�F#<10q=�ad=�XY=@jJDWP�F#MODA<�=�XYI_DGnY=�ad=�XY=�j�DWP�Mdj�Ã�j\UCadMdPA<��JS�HC?E=fe>BTXYI>ad=C��H_g�gfw\?F#MODA<>Mdj�B¦PLMdj>UJaO=]UC?WBTXYXY=�?[PLDA?Nw\gfDAw>?N=�Mdj�;�¥(Á�P��Cj>HC?NXZBTadaOn�BTw_e_MdaOMxBT?Nn¦DA?N=�=QP�o�;�<>=�?N=MxP[BCadPAH(j>H(j\=�=@^�DAH(DWBTadt�BT`:HCw_D�w>j>?N=@PLDA?WBTMdj>=@^�XYHi�C=@XY=�j�D@oc;�<\=�?N=fS�HC?N=C�~;�¥(Á�Pc<\B~�J=PAw>IK=@?AMdHC?�aOH_g@BTadMmDGn3I>?NHCI:=�?ADGn�DN<\BTj¿HTDA<\=�?¦XkHJ?A=�IKHiFE=�?AS�w>a�UC?WBTXYXZBT?#S�HJ?AXZBTadMxPLXZP@�BTjK^ZDA<\=�n�BC?A=�BT`>ad=�DAHZBCg@gfHCw\jJD]S�HC?�axBTj>UJw\BTUJ=�I><>=@j>HCXY=@j\B�F#MODA<\HCw_D#?N=@PAHC?ADAMdj>U%DNHw>j>?N=@PLDA?WBTMdj>=Q^�XYHi�C=@XY=�j�D@oR;�<>=�n�XZB~n�BTaxPLH�<\B~�J=�UC?N=@BiDN=�?RI\PAn_gW<>HCadHCUJMdg@BTal�iBTadMd^_MODGnCo

����������� ������������

¥sadBC?AUJ=�BTXYHCw\jJDRHTS>adMODA=�?WBiDNw>?N=]MxP[B~�iBCMOaxBT`>ad=�HJj�;�¥(Á�P�oR¾l=�=]S�HC?�=fe>BCXkI\aO=��CH�PL<\M´ Ñ ÒCÄ�qCµ8��´ Ñ ÒCÄ Tµf�_É�M ÏLB~nr0G¾l<\BCj>tiBT?#BTjK^��JHJPA<>M�´ Ñ ÒCÒ Ñ µ8o;�<>=#Á¦?A=@MO`KBCgW<%j>HJ?AXZBCaTS�HC?NX�MxP�^>=@PNgf?NMO`:=@^�MOjkBTjln�`KHlHCt�HJj�S�HC?NXZBTa�UC?WBTXYXZBT?WPPAw\gW<¿BCP �(HJI:g�?AHCS¬D�BCj\^ ��aOaxBTXYjs´ Ñ Ò iÒJµfo�¾_=�=Z¾_gW<\BT`:=@Pk´ Ñ ÒCÒ � µES�HJ?�B�^_MxPAg�w\PAPAMdHCjHCj ad=fe_Mdg@BTadMOhQBiDNMOHJj�HCS lEÀ[Áko����������� !"

#�$"%&# ;�=�³\j>=�Mdj>MmDNMdBCa�DA?N=�=QPEDAHZ<\BCj\^_ad=�I\BCPNPLMd�C=QPEMOj DA<\=�S�HCadaOHiF#Mdj>UYPL=@jJDN=�j\g�=@P@b' 2541687305/8- -1& & ��9' 2541687305/8- -1& & � (8+���%'&)('*,+ 9

#�$"%)( ¾l<>HiF Mdj>MODAMxBTaRDA?N=�=QP�S�HC?¦DA<>=k�C=@?A`.G UJMO�J=5Ido ��HCwuPL<\HCw>ax^¿`:=YBT`>ad=kDAH3^_=�?NMO�J=DA<\=�S�HCadaOHiF#Mdj>UZPL=@j�DA=�jKgf=@P@b$�%'&)('*,+ 2'/"! & ��%'& 2'416'7 /+*87 *10'&�6�9$�%'&)('*,+ 2'/"! & /+*'7 * 0'&�6 �'* ��%'& 254 6'7:9' *'7 * 0'&�6 05/ -3254 !8&����'*���%8& 25416'7 (8+ ��%'&3(5*,+ 9' 2541687305/8-32'4 !8& �./,*'7 *108&�6 (8+ ��%8&)(5*,+ 9

¾l<>HiF DA<>=%^>=�?NMO�iBiDNMOHJj�DN?A=@=@P@o#�$"%.- ��BTjK^_aO=�DA<\=6S�HCadadHiF#MOj>UuPL=@j�DA=�jKgf=@P�Mdjz;(¾>Á `lnº^_=f³Kj>MOj\UuPAw>MODNBT`\aO=�MOj>MODAMxBTaDA?N=�=QP�b

Page 172: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ o � �������� ������������� � ����������������! " #����$%$%���

� �.4 - 6'/84 �C4-�82 9� &�4 -)/�� & � 254 �'& &,6 9$�%'& �8/1(57�&�4�- (86'*10)��9

#�$"%�� ¾l<>HiF DN<>=%^_=@?AMd�C=Q^�BCj\^�^>=�?NMO�iBiDNMOHJj�DN?A=@=@PES�HJ?�DA<>=�S�HJaOadHiF#MOj\UYPA=�j�DN=�j\g�=@P�b$�%'&)('*,+ 0 %5*��5/��.('& /��.-�/10�/32541687:9$�%'&)('*,+.-�/10�/3254168730 %5*3(8&8/�� �5/�� 9$�%'&)('*,+.-�/10�/ (5/��'/��5/)0 %C4�� % �5/���(5* �82�%�� 9

l]?N=@BiDN=�BTjln6Mdj>MmDNMdBCa�BTj\^3BCw_e_MOadMdBC?AnYDN?A=@=@PEDN<\BiD(nJHCw j>=�=Q^�o#�$"%�� �(HiFÂF#MOada�nJHCw½<\BTjK^_aO=ZF#<30Ig�w>=QPGDNMOHJj\P��}ÊEw>Mdad^uDN<>=6?N=2g�w>MxPLMODA=YMdj>MmDNMdBCa]BCj\^BTw>elMdadMdBC?AnYDN?A=@=@P�j>=@=@^_=Q^�DNHY<\BTj\^>aO=�DN<>=�S�HCadaOHiF#Mdj>UYPL=@j�DA=�jKgf=@P�b

� %5*)28/"!8&�84 �'/ /3(5*�* ��� %5/�� �54 �:�5/�� 254 !8&��84 �'/ � %5*�� �54 �:�5/�� 254 !8& /3(5* * ��

¾l<>HiF ^_=�?NMd�C=@^ BTjK^�^_=@?AMd�iBiDNMOHJj�DN?A=@=@P@o(´�p UCj\HC?N= G ^_Mx^�I_S�HC?�DN<>=�DAMdXY=�`K=@MOj\U\o µ#�$"%�� ¾l<>HiF ^>=�?NMO�iBiDNMOHJj�DN?A=@=@PES�HJ?�DA<>=�S�HJaOadHiF#MOj\UYPA=�j�DN=�j\g�=@P�b

$�%'&)('*,+ 0 %5*��5*1%5/�� ��%5* �82,%� �5/��.(8&8/��.-�/ 0./3254 6'7:9$�%'&)('*,+ 0 %5*��5*1%5/�� ��%5* �82,%� ('&8/�� �5/��-�/ 0./3254 6'7:9$�%'&)('*,+.-�/10�/ (5/��'/��5/)0 %C4�� %��5*1%'/�� ��%5* � 2�%�:�5/��.(5* �82,%� 9$�%'&)('*,+.-�/10�/ (5/��'/��5/)0 %C4�� %��5*1%'/�� ��%5* � 2�%���1% +'/�� -�/84 �:�5/��

('* �82�%��9

#�$"%�� ¾l<>HiF ^>=�?NMO�J=@^ BTj\^ ^_=�?NMd�~BTDAMdHCj�DA?N=�=QPES�HC?�DA<\=�S�HCadaOHiF#Mdj>UZPL=@j�DA=�jKgf=@P@b� %5*��'4 ���5*1%'/�� ('&87 4,& !8& 2'/ !8& ��%'&3(5* * � �8*��84 �'/�� %5*��'4 ���5*1%'/�� ('&87 4,& !8&��1% +'/�� -�/84 � 2'/"!8&���%'&)(5*�* � �'*�� 4 �'/

#�$"%�� �(HiF g�BTj½DNHCw>UJ<10qXkHi�J=�XY=�j�D�`:=6<\BTjK^_aO=Q^���Á¦Md�C=ZnCHJw>?�PAHCadw_DAMdHCjuS�HJ?%DA<\=S�HCadadHiF#MOj>UZPA=�j�DA=@j\gf=QP�b� �.4 - �'* �82�% �'*3('&87 4,& !8& �'/��.('&8/ ���5*1%5/ ��9�5/��4�- �'* �82,%��'*3('& 784,& !8& (8&8/����5* %5/���9

#�$"%�� ¾l<>HiF ^_=@?AMd�C=Q^ZBTj\^6^>=�?NMO�iBiDNMOHJjYDA?N=�=QP�o#´�p UJj>HC?N=JG ^_Mx^�ICS�HJ?�DN<>=(DNMOXY=¦`K=@MOj\U\o µ� %5*��'4 � ��%'&3(5*,+ 0 %'* /��8& /#(5/��5/ �5/ 254 !8&���%'&)(5*�* ��� %5*�� �54 � ��%8&)(5*,+ 0�%5*��5*1%'/�� ('&87 4,& !8&��./ �8& /3(5/ �5/��5/)2'4 !8&

��%'&)(5*�* ��� %5*�� �54 � ��%8&)(5*,+ 0�%5*��5*1%'/�� ('&87 4,& !8&��./ �8& /3(5/ �5/��5/��'4 �

�1%8+'/�� (8&8784,& ! & 2'/"!8& �,%'&)(5* *���

#�$"%&#�$ ��PL=YS�=QBiDAw\?A=6g�HCj\PLDA?WBTMdj�DNP¦DAH�UJ=�j>=@?NBTDA=kDA<\=6UCHlH_^½PL=@jJDN=�j\g�=@P�BCj\^½`>adHlgWtDA<\=�`\BC^ PL=@j�DA=�jKgf=@P�HCS[DN<>=�tlMOjK^�UJMO�J=�j `K=@aOHiF�o

Page 173: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

���^���^�.� � $% �$%������ �$%���f������� ���3� ��#� � Ñ o Ñ$�%'&�+)%5/"!8& 28*��'& �'* ��%'& � 4 � + 9� � &)%5/ !8& 2'*��8& �'*���%8& � 4 � +�9� � & 2'* �'& �'*��,%'& � 4 ��+$�%'&�+ ��* �57�� %'/"!8& 2'* �'& �'*��,%'& � 4 ��+ 9� & ��* �57�� %5/ !8& 2'*��8& �'*���%8& � 4 � +�9� � & ��* �57�� %5/ -32'*��'&��'*���%'&�� 4 � +� &)%5/ -32'*��'&��'*���%'& � 4 � +

#�$"%&# # Ã�e�DN?NBJg8D-XYH_^>BTadMmDGn�MOj_S�HJ?AXZBTDAMdHCjYMOjkDN<>=(UCHlH_^kPL=@jJDN=�j\g�=@PRMdjYDA<>=#I\?A=@��MdHCwKP=fe_=@?Ng�MdPA=Co#�$"%&#( ��BTj\^_ad=#jlw>X�`:=�?EBTUJ?A=@=�XY=�j�D-MOjZ;�¥(Á `K=�DGF]=@=�j G `KHin:ICBCj\^ G tlj>HiFJITMdjYDA<\=S�HCadadHiF#MOj>UYI><\?NBJPL=QP�b

��%'&)('*,+ 0 %5* ���5*10C- - 0C4���� 4 �82� ��%'&)('*,+5- 0 %'* ���5*105- - 0C4��)�A4 �82��%'&)('*,+ 0 %5* ��%'&�+.-,/,+����5* 0C- - 0C4����A4 �82� ��%'&)('*,+5- 0 %'*���%'&�+�-�/,+����'*10C- - 0C4����A4 �82

#�$"%&#�- ��BTj\^_ad=(jlw>X�`K=@?�BTUJ?A=@=�XY=�j�D-MOj6;�¥(Á `K=�DGF]=@=�j G �(BTX ICBCj\^ G ?Aw>j�IT`K=@aOHiF�o�5/��4�- �'* �82,%��'*3('& 784,& !8& 6����C- / �A4�7�&� �5/��4�- �'* �82,%��'*3('& 784,& !8& 6����./ � 4�7�&� �5/�� /168& �'* � 2�%��'*3(8&8784,& ! & 6����C- / �A4�7�&

Page 174: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ o�d �������� ������������� � ����������������! " #����$%$%���

Page 175: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� � �

� � � � � ����� � � � � ����� �

;�<>=@?A=�BC?A=R?N=�XZBT?NtiBT`>ad=-PLMdXYMOaxBT?NMmDNMO=QP�`:=fDGFE=�=�j¦DN<>=-DA?N=�=�BJ^~ÏGHCMdj>Mdj>U#UC?WBTXYXZBT?-´�;[¥(Á�µBTjK^¿DN<>=�|-BCj>MOj\MdBCj»UJ?NBCXkXZBC?6´�|]Á�µfo�;�=�?NMO�iBiDNMOHJjuDA?N=�=@P%MOj�;�¥(Á BCj\^½XYH_^_Mm³K=�?F0XYH_^_Mm³K=@^�DA?N=�=QP�MOj�|]Á <\B~�C=�BkHCj\= 0ÎDAH 0qHCj\=¦g�HC?N?A=QPLI:HCj\^>=�j\g�=Co;�<>=�^_M :=@?A=@j\gf=QP�?A=@adBTDA=�DAHZ<\BCj\^_adMOj\UkHCS[HJI_DAMdHCj\BCa�BT?NUCw>XY=�j�DWPEBCj\^3PL=@j�DA=�j�DNMdBCaBT?NUCw\Xk=@j�DNPEHTSR�C=@?A`\P@�>BTjK^�adHCj\UY^>MdPLDNBCj\gf=�^_=@IK=@j\^_=�jKgfMd=@P@o�À>HJ?#p j\^_MxBTj3adBCj>UCwKBTUC=QPF#<>MxgW<»^_H j>HCD¦<\B~�J=%adHCj>U3^_MxPGDWBTj\g�=�^_=@IK=@j\^_=�jKgfMd=@P@�c|]Á PA<>HCw\ad^¿IK=@?LS�HJ?AX `:=fDADA=�?DA<KBTj�;[¥(Á}gfHJXYI>w_DNBTDAMdHCj\BCaOadnZ`:=@g�BCw\PA=¦HCS[DN<>=�I>?NMdg�=�I\BTMx^�S�HC?(BC^iÏGw>j\g8DNMOHJj�oÀ�MOjKBTadaOnJ�EMOD�PA<>HCw\ad^v`:=¼j>HTDN=@^sDA<KBiD6DN<>=¼=fe_MxPGDNMOj\U�;[¥(Á BTjK^v|EÁ BC?A=�`:HTDN<ad=fe_Mdg@BTadMOh@=@^vBTj\^v<\B~�J=3aOH_g�BCaOMODGnCo |]Á <\BCP6PAw>I:=�?NMOHJ?ZaOH_g@BTadMmDGn�`:=@g@BTw\PA=�HCI>DAMdHCj\BCaBT?NUCw\Xk=@j�DNP�BCj\^6PA=�j�DA=@j�DAMxBTaVBT?NUCw>XY=�j�DWP�HTS��J=�?N`\P�BC?A=¦B%I\BC?LD]HTScMODNP]tiBT?WBTtiB%gW<\BC?LDQo������� ��2k7�+-5�'%,3!E7R�f5k2;�<>=@?A=�BC?A=R?N=�XZBT?NtiBT`>ad=-PLMdXYMOaxBT?NMmDNMO=QP�`:=fDGFE=�=�j¦DN<>=-DA?N=�=�BJ^~ÏGHCMdj>Mdj>U#UC?WBTXYXZBT?-´�;[¥(Á�µBTjK^%DN<>=(|-BTj>Mdj>MxBTj�UC?WBTXYXZBT?#´�|EÁ�µ8oTÃ��J=�j�DA<>HJw>UC<�DA<\=�DGF]H�S�HC?NXZBTadMdPAXZPRF]=@?A=�^_= 0�C=@aOHJIK=Q^uMOjuDGFEH¼^_M V=�?N=�j�D�DN?NBJ^_MmDNMOHJj\P6´=m»=QPGDN=�?Nj½BCj\^up j\^_MxBTj���?N=@PAIK=Qg8DAMd�C=@aOn>µ�S�HJ?DGFEH3^>M V=�?N=�j�D�axBTj>UJw\BTUJ=@P¦HC?NMdUCMdj\BTadaOn�´�Ã�j>UJaOMxPA<½BCj\^º¾_BTjKPLtl?NMmD8µ8��DN<>=�nu`:HTDA<½<\B~�J=PAMOXYMdadBC?�PGDN?Aw\gfDAw>?N=@P@o ��=�?N=C�JF]=�F#MdaOa>adHlHCt�BTD-DA<>=#`KBCPAMdg�PAMOXYMdadBC?AMODAMd=@P-BCj\^YBTaxPLH�PAHCXY=^_M :=@?A=@j\gf=QP�o�����'& *���.���$f"�+��87R���(0�� ��7! Â����2 ( ) "%23'#" );�¥(Á gfHJj\PAMd^_=@?NPY^_=@?AMd�iBiDNMOHJj�DA?N=�=QP�DAH½`K=3MdXYIKHJ?LDWBTj�DZ?NBTDA<>=@?�DN<\BTjsDA<\=3^>=�?NMO�J=@^DA?N=�=QP�´ �CH�PL<\M�� Ñ ÒJÄrqJµ8o�|EÁ�gfHJj\PAMd^_=@?NP�XYHl^>Mm³\=@?K0qXYH_^_Mm³K=@^�DN?A=@=%DNH�`:=�DN<>=kMOXYI:HC?F0DNBCj�DYPLDA?Nw\g8DNw>?N=»´�PA=�=/l]<\BTIco qJµ8o½;�<>=�?N=�MxPYB¿^_Md?N=@g8DYgfHJ?A?N=@PAIKHJj\^_=@j\gf=6`:=fDGFE=�=@j^_=@?AMd�iBiDAMdHCj�DA?N=�=QP�HCj�DA<>=�HJj>=�<\BTj\^3BCj\^�XYH_^_MO³\=�?F0qXkH_^_MO³\=Q^6DN?A=@=@P�HCj�DA<\=�HTDA<\=�?Qo¥�P�BTj =fe>BTXYI>ad=C�lDN<>=%;[¥(Á}^_=@?AMd�iBiDAMdHCj�DA?N=�=¦S�HJ?�DA<>=%PA=�j�DA=@j\gf=Jb

Ñ oCÅ

Page 176: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ o � �������� ����p�p���#� $% ������ "� � ��%�����

o o o o o o o o o o o o

ooooooooooo

5f6�7 8

5 @'BDCFE�� @�� @��5�G HFJ ´ Ñ µ

5 :=<?> ´ Ñ µ 5 7 ´ Ñ µÀ�MdUCw>?N= ÑCÑ o Ñ b�¥�;�¥(ÁÐ^>=�?NMO�iBiDNMOHJj�DN?A=@=Co

$�%'&)('*,+.-�/10�/32541687:9

MxP#PL<>HiF#j Mdj3À�MdUCw>?N= ÑCÑ o Ñ o¾lMdXYMOaxBT?NaOnJ�TDN<>=�XYH_^_MO³\=�?F0ÎXYH_^_MO³\=@^kDN?A=@=#MOj�|]Á S�HC?-DN<>=(S�HJaOadHiF#Mdj>U%PL=@j�DA=�jKgf=(Mdj

�(Mdj\^_MÎb

�C-�/ 7�/��'/ �5&:�8& & �C/ 7 /��'/ �C4 4 �C*��8& �8%5/ /:9��%5/��)(5*,+ &�6�2'/��54 ! &�/)25416'7 /��� �C-,/��54 !8&.-,/10� $�%5/ � (5*,+�-,/10./)254 6'7:9

MxP#PL<>HiF#j Mdj3À�MdUCw>?N= ÑCÑ o d>o

Page 177: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�p�r� � �.�^��$/� �A��#���f�� � �� �� � � ��� � ����" Ñ o�q

w\PNB3´¬DA<KBiDWµ´Pd Ñ o Ò pdpd _� qpo>o Ò � qpqCµ�´Pd Ñ o Ò �dpd l� � µ BC^iÏfo

axB5;¦BTtiBTB\´�`KHin>µ

=@tiB�´�BJµ´ Ñ q>o Ñ ÅCÄCÒ�d_�eq o\o Ò � qpqJµf´ Ñ q_o Ñ ÅCÄCÒpd>� � µ BJ^~Ïfo

axB5;¦BTtlMdMδ�UCMd?Aa¬µ´ ÑR�>Ñ o Ñ dTÒCÄJÄ>�eq o\o Ò � qpqCµf´Pd Ñ o Ò dpd �� � µ tiBT?ADNB´ Ñ2�\Ñ o Ñ diÒJÄTÄ>�eq�o>o Ò � q qCµ�´ Ñ Ä lo Ñ d � Ä o>� � µ t~BC?AXZB

^_=�tl<\B�´�PL=@=Qµ

;�<\=YPAMdXkMdaxBT?NMmDNMO=QP%BT?N=�DNHlH

À�MOUJw>?A= ÑJÑ oed_b-¥�|]Á XkH_^_MO³\=@?K0qXYHl^>Mm³\=Q^6DN?A=@=HC`l�lMdHCw\PRDNH%`:=�XYMdPNPA=@^�o-y(HCDA=�BCadPAH�DA<\=�gfHJ?A?N=@PAI:HCj\^_=@j\gf=�`:=fDGFE=�=@jZDA?N=�=�BJ^>^_?N=@PNPL=QPMdju=@aO=@XY=�j�DNBC?An¿DA?N=�=@P�HCS�;�¥(Á ´�=Jo UKoO��BC^>^_?N=@PNPZ´ Ñ µ�BTjK^v´ d_oedCµ�Mdj 5 6�7 8 µ%BTj\^»DA<\=tiBT?WBTtiB#axBT`:=�alHTS\^>=�XZBTj\^�F]HJ?N^%MOjk|]Á�´�=Jo UKoO�itiBC?LDWB�BTjK^�tiBT?NXYB�HTS\^_=@tl<\BCB�´�PNB~F�µLµ8o¥�^\^_?A=QPAPA=@P�F#<>=�?N=�PAw>`\PLDAMODAw_DNMOHJjZDNBCtC=@P�I>axBCgf=�MOj�BCjZ=�ad=�XY=�j�DWBT?Nn�DN?A=@=(MOjK^_Mdg@BiDN=MODNP�BC?AUJw>XY=�j�DNP@��PLMdXYMOaxBT?NaOnzDA<>=¿t~BC?NBCtiBCPYMdj\^_Mxg�BiDN=�DA<\= � BC?AUJw>XY=�j�DNP��¿HCS%B½�C=�?N`^_=@XYBCj\^YFEHC?W^�o�À\HC?]=fe>BTXYI>ad=C��BC^>^_?N=@PNP Ñ HCS 5f6�7 8 �_B¦S�HJ?AXZBTaKHC`_ÏG=Qg8D]BTD�DA<\MdP]aO=@�C=@aHTS�BTj\BCaOn_PAMdP@��g�BCj»`:=YXZBTI>I:=@^¿DAH�BTj½BTI\I>?AHJI>?NMdBTDA=�DA<>=�DNB ?AHJaO=YPAw\gW<uBJP�BTUC=@j�D�BTDDA<\=(j>=felD�ad=��J=�aKHTS�BTj\BCaOn_PAMdP@ocp jYDN<>=�g@BCPA=#HTS�|]Ák�CDA<>=(axBT`:=�aKtiBT?ADNB>��BTU�BTMdjkB�S�HJ?AXZBCaHC`>ÏG=@g8D%BTD¦DN<>MxP�aO=@�C=�a-HCSEBCj\BTadn_PLMxP���g@BTju`K=YXZBTI\IK=Q^¿DNH�BTUC=@j�D�DN<>=fDWB�?NHCad=ZBiD�DA<\=j>=�e�D(ad=��J=�a�HCS�BTjKBTadnlPAMxP�o >pqD¦PA<>HJw>ad^3`:=�j\HTDA=Q^��:<>HiF]=@�C=@?@�_DN<\BiD�DA<>=�DA?N=�=kBC^>^_?N=@PNPA=@P(g@BT?N?An�MOj_S�HJ?AXZBTDAMdHCjBT`:HCw>DkFEHC?W^½HC?W^_=�? ´�=Jo UKoO��BJ^>^_?N=@PNP�´ Ñ µ�Hlg@gfw>?WP�`K=�S�HC?N=�BC^\^_?A=QPAP ´Pd>o dJµLµ%F#<>=�?N=@BJPDA<\=�t~BC?NBCtiBCPk^_H½j>HTDQo ��BC?NBCtiBCP@�-MOjvS�BCgfD@�]?A=@adBTDA= DAH½�lMO`\<\BTt�DAM @ S�HJ?kS�?A=@= FEHC?W^HC?W^_=@?-adBCj>UCw\BCUC=QP��i`>w>D-DA<\BTD�MdPRIKBT?AD�HTS:DA<>=#tiBT?WBTtiB�gW<\BC?LDWP-BTj\^k�lMO`\<\BTt�DAM>^>H�=QP-j>HCD=fe_I>adMxgfMODAadnzBTI>I:=@BC?YMOjsDA<>=3XYH_^_MO³\=�?F0ÎXYH_^_MO³\=@^zDA?N=�=Jov¾lMdj\g�=���Md`><\BCt�DAM�<\BCPY`:=�=@jw\PA=@^YBTjK^kBC`\PLDA?WBCg8DN=@^kB~FEB~n�MdjYHC`_DWBTMdj>Mdj>U�DA<>=#XYH_^_MO³\=�?F0qXkH_^_MO³\=Q^�DN?A=@=C�JMmD�MxPRHCj\aOnBTI\I>?AHJI>?NMdBTDA=#DN<\BiDEMmD�`K=�PAH\oR;c?N=�=¦BC^>^_?N=@PNPA=@P�Mdj�;�¥(Ák�lF#<>MOad=�I:=�?AS�HC?NXYMOj\U�PAMOXYMdadBC?BT`KPGDN?NBJg8DAMdHCjc�Vg�HCj�DAMdjlw>=%DNH�<KB~�C=�HJ?N^>=�?¦MOj_S�HJ?AXZBTDAMdHCj¿BJP¦B�aO=�S¬DK0qHi�C=@?@oZ´�;�<\MdP�^_Hl=@Pj>HCD�g�BTwKPL=�BTjln6I>?NHC`\aO=@X �_<\HiF]=@�C=�?Qo µpqS�HJj>=�gfHJXkIKBT?N=@P�DA<>=�=@aO=@XY=�j�DNBC?AnºDN?A=@=@P3´�MÎo =Cod�EMdj>MODAMxBTa�DN?A=@=@PZBTjK^vBCw_e_MOadMxBT?NnDA?N=�=QPNµ�Mdj»;�¥(Á F#MmDN<»tiBC?NBCt~B�gW<\BT?ADNP�Mdj»|]Ák�VHJj>=�BCUJBTMdj�³\jK^>P�B�PAMOXYMdadBC?AMODGnCo%¥�j

���5%)�+��� &'�0��#�& � �+��� "�� � %)�+��� &'" ��%�������08�3 ,-��1'#$"�,��5/�� ,-/�1'&'2-� # ��, #��� � "�#7��& � &'1 ����& ��� &'"� �+��"�&'"�2 ,�5��#�#���� ����� 3(%)�+" & � , � � ����� &'" � 3 ,$#)& � � ���+" � ����� �+�+<�� � 3 ,-��1'# ��& ����1 �$/�� � �����+���#�#���� ���!��%���� , � � ����� &'"$� 3 ,7#�& � � ��� " �!����� � ����� 8 ,-".��%�� ,���%�� � %���")# 3 ,-��1'# / � ,-/�1'&'2-� # ��,����"�# #�, � ����#��� � "�# ��%)� �)��� ,���%�� � ��� �!1 ��/�� 1����������4&'" � 3 , #�& � �+��� "��5����� �+�+<

�� !&'/�%���� ��& ������"�#�� � ,-1'1'� � ��& ! � 1 �" ,-� �+����� � "�#�&'"�2-���#��,-���$��,-��& ��&',-"�� ��"�#%��������,-��& ��&',-"����9,-�4�� ,&� /�&'"�����&',-" ��%�� ���+,�'��#������ "�#�&'"�2 ,-" ��%)� 1 ��"�2-����2-�-<

Page 178: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ oro �������� ����p�p���#� $% ������ "� � ��%�����

Mdj>MmDNMdBCalDA?N=�=]S�HC?�B��C=@?A`kBTj\gW<>HJ?@�_´�HC?-B�^>=�XZBTj\^�FEHC?W^\µ�MxPRadMOtJ=EB�tiBT?WBTtiB�gW<KBT?ADE´�HJ?-B^_=@XYBCj\^6gW<\BC?LD8µ8o-;�<>=�MOj>MODAMxBTa:DN?A=@=(S�HC?EB%�J=�?N`�PLI:=@g�Mm³K=@P¦´�BTadHCj\U%F#MmDN<�Mdj>MODAMxBTa:DA?N=�=QPS�HC?�j>HCw>j3=�DNgTo µY<>HiF DA<\=%j>HCw\j\P � ³\D��YMdj F#MODA<3DN<>=%�J=�?N` BCj\gW<>HC?Qo�;�<>MxP � ³>DLDNMOj>U��MxP#I>?NMOXZBT?NMdaOn6Mdj3DA=@?AXZP#HCS�FEHC?W^�HC?W^_=�?Qo�;�<>=�tiBT?WBTtiBYgW<\BC?LD#Mdj¼|]Ák�>HJj�DN<>=%HCDA<>=@?<\BCj\^��JPAI:=@gfMO³\=QP�F#<\BTD���Md`><\BCt�DAMxP-X�w\PLD�H_g�g�w>?�F#MODA<YDN<>=(j>HJw>j\P@�TS�HC?�DA<>=@XÐDNH � ³>D��Mdj»F#MODA<»DA<>=Y�J=�?N`�o�;�<>MxP�³>DLDNMOj\U MxP�Mdj¿DN=�?NXYP¦HCSEgfHJj\PLDA?WBTMdjJDWP�HJj»�lMd`><\BCtJDNMdP@o�¥�aOaDA<\MdPYMxPYIK=@?LS�=Qg8DNaOn�?N=@BJPLHJj\BT`\aO=Jb�|RHJPAMODAMdHCj�FEHC?Nt_P�S�HJ?YIKH�PLMODAMdHCj\BCa�adBCj>UCw\BCUC=QP�BCj\^�lMO`\<\BTt�DAMEFEHC?NtlP�S�HC?%S�?N=�=�F]HJ?N^uHJ?N^_=@?�axBTj>UJw\BTUJ=@P@o mËMmDN<�DA<\=�?N=@gf=@j�D�I>?NHCI:HJPA=@^=felDN=�j\PAMOHJj\PRDNH�;[¥(Á `ln�É�M ÏLB~n�0G¾l<\BCj>tiBT?�´ Ñ ÒCÒ�dCµ�BTjK^ �#HCUJ=�?WP-BTj\^kÉ�M ÏLB~n�0 ¾_<\BTj>tiBC?´ Ñ ÒCÒ�dCµ(BCj\^z´ Ñ ÒJÒCÅJµf�:DA<>=YgfHJj\gf=@I_D¦HCS�g�w\BJPLM 0�DN?A=@=@P�gfHCXY=QP�=@�C=@j»gfadHJPA=�?�DAH3tiBT?WBTtiBgW<\BC?LDWP�`:=@g@BTw\PA= DA<>=�j\HTDAMdHCjsHTS¦DA?N=�=3MxPYXYBJ^_=3XYHC?N=�S�?N=�=�BTjK^sg�HCj\PLDA?WBTMdj�DNPYBT?N=MdjJDN?AH_^_wKgf=@^�o;�<>=QPL=-`\BJPLMxg�PAMOXYMdadBC?AMODAMd=@PcH_g�gfw\?�MOjKPLI>MODA=]HTSlDA<\=-S�BCgfDcDA<KBiD�DN<>=�S�HJ?AXZBTadMxPLXZP�FE=�?N=^_=@�C=�adHCI:=@^�Mdj\^_=@IK=@j\^_=@jJDNaOn�BCj\^�MOj�DGFEH(=�e�DN?A=@XY=�adn�^_M :=@?A=@j�D�PNgf=�jKBT?NMOH�P�o�;�<>MxPcPAw>Up0UC=QPGDWP-DN<\BiDEDA<>=¦PLMdXYMOaxBT?NMODAMd=@PEBT?N=�B%PAMOUJj6HTScB�^_MdPNgfHi�J=�?Nn�HCScPLHJXk=�^_=�=@I�w>j\^>=�?NaOnlMdj>UI>?NMOjKgfMdI>aO=QP�HTSRadBCj>UCwKBTUC=Jo������ � ���u��+-��23!#�(0 .u��7 �(��2 ( ) "%23' "�);�<>=#^_M :=@?A=@j\gf=QPRBT?NMdPA=]XZBCMOj>adn%`:=@g@BTw\PA=E;�¥(ÁËwKPL=QP�BJ^~ÏGw>j\gfDAMdHCjkF#<>=�?N=@BJPR|]Árw\PA=@PtiBT?WBTtiBZgW<\BC?LD�g�HCj\PLDA?WBTMdj�D�PABTDAMxPGS�BJg8DAMdHCj3DNH6<\BCj\^_ad=�DA<>=kPABCXY=%adBCj>UCwKBTUC=�I><\=�j>HJX!0=�jKB>ocp j�I\BT?ADAMxgfw>axBT?Q�~F]=]aOHlHJt¦BTDcDA<\=]<\BCj\^_adMOj\U�HTS>HJI_DAMdHCjKBTaJBC?AUJw>XY=�j�DNP@�iPL=@j�DA=�j�DNMdBCaBT?NUCw\Xk=@j�DNP@�lBCj\^ aOHJj>UZ^_MxPGDWBTj\g�=�^>=�I:=�j\^_=@j\gfnJo��������� � � ���� ���������� ��� "� �

É-=�?N`\P�DNBCtC=6HJI_DAMdHCj\BCa � BT?NUCw>XY=�j�DWP�� F#<>MxgW<�Mdjz;[¥(Á�PkBT?N=6<\BCj\^_ad=@^º`ln»DA<>=3BC^10ÏGHCMdj>Mdj>UYHCI:=�?WBiDNMOHJj�o-;�<�wKP��_DNHYUC=�j\=�?WBiDA=�DA<\=%PL=@jJDN=�j\g�=Cb$�%'& (5*,+ -,/10./)254 6'73(8+ �,%'& 654 ! &�6DA<\=�HCI>DAMdHCj\BCaCBT?NUCw>XY=@jJD�HCS_aOH_g�BTDAMdHCj6´ G `ln�DA<>=�?NMd�C=�?�I µ:MdPcMOj\PA=�?ADA=Q^�`ln�DN<>=]BJ^~ÏGHCMdj>Mdj>UHCI:=�?WBiDNMOHJj�o�|]ÁÂ<\BCj\^_ad=@P�HCI_DNMOHJj\BTaRBT?NUCw>XY=@jJDWP(`ln3tiBT?WBTtiB6gW<\BC?LDWP�BCj\^��lMO`\<\BTt�DAMgfHJj\PLDA?WBTMdjJD6PNBiDNMdPLS�BCgfDAMdHCj��]DA<>=¼PNBTXY=�XY=@gW<KBTj>MxPLX DA<\BTD�MdP6w\PL=Q^sS�HC?ZXZBTj\^\BiDAHJ?AnBT?NUCw\Xk=@j�DNP@o�;�<>MxPE<\BCP�B�`K=�DLDN=�?�aOH_g@BTadMmDGnZI>?NHCI:=�?ADGnYF#<>=�?N=¦F]=¦w\PA=�DN<>=¦PNBTXY=�^_=fSi0Mdj>MmDNMOHJj�HCS[adH_g�BTadMODGnYDA<\BTD�MxP�w\PA=@^�`�n�?A=QPL=QBT?WgW<6F]HJ?AtJ=�?WP�Mdj ;�¥(Á ´Î¾_gW<\BC`K=QP�� Ñ ÒJÒ � µfoÉ�BT?NMdHCw\P�g�HCj\PLDA?WBTMdj�DNPRHJj�S�=QBiDNw>?A=�PGDN?Aw\gfDAw>?N=@P�HTSVHCI_DNMOHJj\BTa>HJ?AUJw>XY=�j�DNP@�CPAw\gW<6BCP�PL=�0ad=@g8DNMOHJj\BTaK?A=QPGDN?AMxg8DNMOHJj\P@�TS�HCadadHiFsS�?NHCX}DA<\=��C=@?A`co[p j6;�¥(Ák�CDN<>=�nY`:=@g�HCXY=(j>HJj10ÎadH_g�BCaF#<>=@?A=QBCPEMOj�|EÁ�DN<>=�n6?N=�XZBCMOj aOH_g@BTaVDAHYDN<>=�tiBT?WBTtiBkgW<\BT?AD�S�HC?�DA<\=��C=�?N`�o

���������� � "� ��"� �� ����� ���+������������� ��� � �

¥�^iÏGw>j\g8DNMOHJj¿MxP�BCadPAH6w\PA=@^¼MOju;[¥(Á}DNH�<\BCj\^_ad=%DA<\HJPA=�BT?NUCw\Xk=@j�DNP(HCS�B6�J=�?N`3DA<\BTDDNBCtC=%BZPA=�j�DA=@j\gf=�´�HC?�BY�C=�?N`3I><>?WBCPA=Qµ�BJP(BTj�BT?NUCw\Xk=@j�D@o]À\HC?(=�e>BTXYI>ad=C�>DN<>=�BCw_e^0MdaOMxBT?Nn�DA?N=�=kS�HJ?�G DN<>HCw>UJ<�D,I�´�À[MdUCw\?A= ÑCÑ o Å�µ�IK=@?AXYMODNP�G DA<>HJw>UC<�D�IVDAH�`:=ZMOj\PA=�?ADA=Q^¿`ln

Page 179: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�p�r� �3� ��� � �� �� �� �� � � �� � � ��� � ����" Ñ o

444

� :=<?H��R@ <2:

X-` _/`

b

SRT Z L T S

b_

bb

À�MOUJw>?N= ÑJÑ o Å>b-¥(w>elMdadMdBC?AnZDN?A=@=¦S�HC? G DA<>HJw>UC<�D,I

BC^iÏGw>j\g8DNMOHJj½MOjºB DA?N=�=kS�HJ?�MmDWP%PL=@j�DA=�j�DNMdBCa�BT?NUCw>XY=@jJDQoZ;�<>MdP%MdP%BCaO?N=@BJ^_n¼^_M :=@?A=@j�DS�?NHCX =@BC?AadMO=@?�w\PA=¦HTScBC^iÏGHCMdj>MOj\U�`:=@g�BCw\PA=�j>HiFrDN<>=�Mdj>MODAMxBTa:DA?N=�=¦gfHJ?A?N=@PAIKHJj\^>P�DAH�BCjBT?NUCw\Xk=@j�D@�lF#<>=�?N=@BJP]DA<>=�BTw>elMdadMdBC?AnYDN?A=@=�MxPEDA<>= � I>?N=@^_Mxg�BTDA= �\o�|EÁ�<\BCj\^_ad=@PE�C=@?A`KPPAw\gW<�BCP�BT`:Hi�C=YDA<\?AHJw>UC<uDA<\=�tiBT?WBTtiB�gW<\BC?LD%XY=@gW<KBTj>MxPLX3o¼À\HC?�PAw\gW<º�J=�?N`\P��[DA<\=BTI\I>?AHJI>?NMdBTDA=�tiBC?NBCt~B¼MdPkXZBT?NtC=Q^ºDAHu<\B~�J=�B»�C=�?N`zBJP�MODNPk³\adad=�?Qo�¥#S¬DA=@?YDA<>MxPkDA<\=j>HJ?AXZBTa�XY=�DA<>H_^ HTS�t~BC?NBCtiB�gW<\BC?LD(g�HCj\PLDA?WBTMdj�D#PNBiDNMdPLS�BCgfDAMdHCj�DNBTtJ=@P�Hi�J=�?QopqD�PA<>HCw\ad^3`:=%I:HCMdjJDN=@^�HJw_D(DN<\BiD(DN<>=%w\PA=%HCS-BJ^~ÏGw>j\gfDAMdHCj�DNH6<\BCj\^_ad=�DA<>=�I><>= 0j>HJXk=@j\BkBT`:Hi�C=�MxPEj>HTD#F#MODA<>HJw_D(B�I\?AMxgf=JoR;�<\=�FEHC?WPGD�g�BJPL=�BCPAnlXkI>DAHTDNMdg¦gfHJXYI>aO=�e^0MODGn ?N=@PAw>aOD�S�HJ?¦B6;�¥(Á I\BC?NPA=�?�MdP��Y´�� � µ8�VF#<>MdaO=�S�HC?�DA<>=k?N=@PLDA?NMdgfDA=@^3tiBC?NBCt~B�gW<\BT?ADPNBiDAMxPLS�BCg8DNMOHJj�MOD(MxP��Y´�� B µ�´�PA=�=!l]<\BCI�o oJµ8o���������� � � � �� � � � ������� ���+��"� � � "���

À�MOjKBTadaOnJ�RBJ^~ÏGHCMdj>Mdj>U¼HJIK=@?NBTDAMdHCj½MdP�BTaxPLH�wKPL=Q^uDAH¼<\BCj\^_ad=6w>jl`:HCw>j\^>=@^ºXYHi�C=@XY=�j�D´�HJ?�aOHJj>Uk^>MdPLDNBCj\gf=�^_=�I:=�jK^_=�j\g�n>µ�PLw\gW< BCPEXYHi�C=@Xk=@j�DEHCS[BkF#<10Î=@aO=@XY=�j�DEMdj3B�F#<10g�w>=@PLDAMdHCjcor;�¥(Á�PZ<\BCj\^_ad= DA<>=QPL=��J=�?Nn�gfad=@BTj\aOnsF#<>MdgW<vMxPZB½XYBTÏGHC?ZPLDA?N=�j>UCDA<vHTS;�¥(Áko�¾lw\gW<YXYHi�C=@XY=�j�DNP-BC?A=#j>HCD�tlj>HiF#j�DNH%H_g�g�w>?-MOjZp jK^_MdBCjYadBCj>UCw\BCUC=QP�o �(=�jKgf=C�DA<\MdP�MdPkj>HCDkBCj�MdPNPAw>=ZS�HC?kp j\^_MxBTjzadBCj>UCw\BCUC=QP�oz´ �#=@PA=@BC?NgW<º<KBCP%`:=�=@jsg�HCj\^_wKg8DA=Q^HCj3<>HiF�|]ÁÂg@BTj3`K=�BTI>I>adMd=@^�DAH�Ã�j>UCadMxPL< DAHZ<KBTj\^_ad=�adHCj>U6^_MxPLDNBTjKgf=�^_=@IK=@j\^_=@j\gfn´�ÊE<\BTDLDQ� Ñ ÒCÒCÅ�µ�BCj\^ XYHC?N=¦FEHC?NtZj>=@=@^>PEDNHZ`K=%^_HJj>=Co µ

Page 180: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ oJÄ �������� ����p�p���#� $% ������ "� � ��%�����

;�<>=�?N=��J=�?WPL=/g�w>=@PLDAMdHCjrF#<>MxgW< g�BCjr`K=¿BJPLtJ=@^�b lEBTjË;[¥(Á�P�<\BTjK^_aO=�p jK^_MdBCjaxBTj>UJw\BTUJ=@P �Æ;�<\= BCj\PLFE=�?kUCMd�C=@j�`ln �CH�PL<\M]=�DYBCa�o ´ Ñ ÒCÒ Ñ µ%MdP�DA<KBiDY`�n½?N=�axBie_Mdj>UDA<\=�HJ?N^_=@?AMdj>U gfHCjKPGDN?NBCMOj�D�HJj¿gW<>Mdad^>?A=@j¿HTSEB�j>H_^_=kMdj»BTj»=�ad=�XY=�j�DWBT?Nn HJ?¦^>=�?NMO�J=@^DA?N=�=J�TS�?N=�=(FEHC?W^kHC?W^_=�?-axBTj\UCw\BCUC=@P-g@BTjZ`:=(<\BCj\^_ad=@^�o-ÊEw_D�<>=@?A=#HJj>=(XYMdUC<�D�=�jK^Yw>II\B~nlMdj>U6BZI>?NMdg�=%Mdj¼=��6gfMd=�jKgfn `K=Qg�BTwKPL=%IKBT?WPLMdj>UZHTSRDN<>=@PA=�XZB~n6DNw>?Nj¼HCw_D�DAH6<\B~�J=DA<\=%PABCXk=�I>?NHC`\aO=@X BCP�I\BC?NPAMdj>U�F#MODA<3p ;��i{[|sUJ?NBCXYXYBC?NP�´�ÊEBC?LDNHCj�=fD�BTaÎod� Ñ ÒCÄ Cµ8o����� � � ��0[!�,30�0R�f5�2À>HJ?�p j\^>MdBCjºadBCj>UCw\BCUC=QP�F#<>MxgW<z^_H¼j>HCD�<\B~�J=6aOHJj>U¼^_MxPGDWBTj\g�=�^_=@IK=@j\^_=@j\gfMd=@P@�-|]ÁPA<>HCw>ax^�IK=@?LS�HJ?AX `:=fDADA=@?-DA<\BCjZ;[¥(Áд�`:=@g�BCw\PA=#HTS\DN<>=#I>?NMdg�=�I\BTMx^�S�HC?�BC^iÏGw>j\g8DNMOHJjKµ8o;[H�<\BCj\^_ad=�S�?N=�=�F]HJ?N^YHJ?N^_=@?@�l;�¥(Á�P]<KB~�C=#DNH�?N=�axBieZHC?W^_=�?NMdj>U%F#<>MxgW<6XZB~nYaO=QBC^YDNHB�S�w>?ADA<>=@?�I>?AMxgf=YMdj»=��6gfMd=�j\g�nCoZ|]Ák��HJj¿DN<>=YHTDA<\=�?�<\BCj\^���w_DNMOadMdh�=@P�DA<>=Y�lMO`\<\BTt�DAMgfHJj\PLDA?WBTMdjJDWPEDAHZ`>w\MOax^�BTj�=��Zg�MO=@j�D�PLn_PLDA=�X3o]pqD�?A=@XZBTMdj\P(BTj3HJIK=@j g�w>=QPGDNMOHJj�BCP�DNH<>HiF F]=@aOa�^_Hl=QP(|]Á <\BTj\^>aO=�adHCj>UZ^_MxPGDWBTj\g�=%^_=�I:=�jK^_=�j\g�MO=QP�o

mËMODA<�DN<>=%?N=@gf=@j�D�I>?NHCI:HJPNBTaxP�DAH�gW<KBTj>UJ=%;[¥(Ák�KDA<>=�j>=�F g�w\BJPLM 0�DN?A=@=@P(BC?A=�`:= 0UCMdj>j>Mdj>U�DNH¿adHlHCtu=��C=@jºXYHC?N=6aOMdtC=6DA<>=�t~BC?NBCtiB�gW<\BT?ADNP%BCj\^ºHCDA<>=@?�PLDA?Nw\g8DNw>?A=QP%Mdj|]ÁkoÀ�MOjKBTadaOnJ�EMOD�PA<>HCw\ad^v`:=¼j>HTDN=@^sDA<KBiD6DN<>=¼=fe_MxPGDNMOj\U�;[¥(Á BTjK^v|EÁ BC?A=�`:HTDN<ad=fe_Mdg@BTadMOh@=@^vBTj\^v<\B~�J=3aOH_g�BCaOMODGnCo |]Á <\BCP6PAw>I:=�?NMOHJ?ZaOH_g@BTadMmDGn�`:=@g@BTw\PA=�HCI>DAMdHCj\BCaBT?NUCw\Xk=@j�DNPEHTSR�C=@?A`\P�BC?A=�BkI\BT?AD#HTSRMmDWP#tiBT?WBTtiBkgW<\BT?AD@o����������� ������������

�#=Qgf=�j�D�I>?NHCI:HJPNBTaxPV`ln�É�M ÏLB~n�0G¾l<\BTj\tC=�?�BCj\^¦<>MdPcUC?NHCw>IY´�É�M ÏLB~n�0G¾l<\BCj>tC=@?�´ Ñ ÒJÒrdJµ8��#HJUC=�?WP¦BTj\^»É�M ÏLB~n�0 ¾l<KBTj>tJ=�?Y´ Ñ ÒJÒrdJµ8�-´ Ñ ÒCÒCÅ�µLµ�BT?N=�j\HTDA=@F]HJ?LDN<lnCo mËMODA<uDA<\=YPAw>Up0UC=QPGDN=@^�gW<KBTj>UJ=@P@�[DN<>=�j\=�F ;�¥(Á�P�F#MODA< g�w\BCPAM 0ÎDA?N=�=QP�`:=�UCMdjºDNH»adHlHCtu=��C=@j�XYHC?N=adMOtJ=�DN<>=%|-BTj\MOj>MxBTj UC?WBTXYXZBT?Qo;�<>MxP�gW<KBTI_DN=�?kMdP�`\BCPA=@^�HCjsÊE<\BC?NBTDAM]=fDZBTaÎor´ Ñ ÒJÒ � `:µ8o½;�<>=�?N=�MxP�B¿j>=�=Q^ºDNH=fe_I>adHC?N=�DN<>=kBCI>I>adMdg@BiDNMOHJj�HTS�|]Á}DNH�Ã�j>UCadMdPA<�´�ÊE<\BTDLDQ� Ñ ÒCÒJÅJµ8o �¼BTjln3MOj�DN=�?N=@PLDAMdj>Uj>=@F ?N=@PAw>aODNP#BT?N=¦aOMdtC=@aOnZDNH6gfHJXk=�HJw_D(HTSRPLw\gW<3BTj3=�el=@?Ng�MdPA=Co

Page 181: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� ���

����� ��� � � � � � � � � ��� � ��� �

Á¦Hi�C=@?Aj\Xk=@j�DZBCj\^ËÊEMOjK^_MOj\U ´�Á�Ê#µYMxPZDN<>=¿^_HJXkMdj\BCjJD6adMdj>UCw>MxPLDAMxg3DA<>=@HC?NnC��nC=�D�MOD<\BJP�j\HTDZ`K=@=�jr�C=@?AnºI:HCI\w>adBC?YF#MmDN<vg�HCXYI>w_DWBiDAMdHCjKBTa#adMOj>UJw>MxPGDWP�ov;�<>=�?N=�BT?N=�DGFEH?N=@BCPAHCjKPES�HC?#DN<>MdP@o(À�MO?WPLD@�:Á�Ê ^_Hl=@P(j>HTD�BJ^>^_?N=@PNP�DA<\=%I>?NHC`>ad=�X1HTS-=�MODA<\=�?(I\BC?NPAMdj>UHC?�UJ=�j>=@?NBTDAMdHCj�oR¥�P�B�?A=QPLw>aOD@�_MOD#I>?NHCI:HJPA=@P]MmDWP�S�HJ?AXZBCaOMxPLX�Mdj3B%S�HJ?AX�F#<>MxgW< MdPEj>HCDBTXY=@j\BT`>ad=6DNHug�HCXYI>w_DWBiDNMOHJjs^_Md?A=Qg8DNaOnJos¾l=@g�HCj\^��]Á�Ê tC=@=�I\PkgW<\BTj\UCMdj>U»PAH¿X�w\gW<BTjK^kPAH�?NBCI>Mx^_aOnJ�iDA<KBiD�MOD�MdP�^_M �6g�w>amD�DAH�tlj>HiFzF#<KBiD]Á�Ê�MxP�BTD-BCjln�UCMd�C=@j�DNMOXY=(BCj\^MdXkI\aO=@Xk=@j�D�MmDQo�p j�DA<\MdP�gW<KBTI_DN=�?Q�TF]=#PAtC=�DNgW<ZÁ�ʽDA<>=@HC?Nn�BTjK^�UJMO�J=�PAHCXY=]DA=@jJDWBiDNMO�J=PAw>UCUJ=@PLDAMdHCj\P]S�HC?#MdXYI>ad=�XY=�j�DAMdj>UZMOD#S�HC?(BCj Ã�j>UCadMdPA< aOMdtC=�axBTj>UJw\BTUJ=Co� &Z��� ��2k7�+-5�'%,3!E7R�f5k2mu=�`K=@UCMdj�`ln�I:HJPAMOj>U(B#g�w>=QPGDNMOHJj�b mË<ln�Mdj\PAI>MODA=�HCS�`:=�Mdj>U#DN<>=�^_HJXkMdj\BCjJD�adMdj>UCw>MxPLDAMxgDA<\=�HC?NnC�i<KBCP-Á¦Hi�C=@?Aj>XY=@jJD-BTjK^�ÊEMOjK^_MOj\UY´ÎÁ�Ê#µc`:=�=@jkg�HCXYI\BC?NBTDAMd�C=�adn�aO=QPAP�I:HCI>w\adBC?F#MODA<�gfHJXkI\w_DNBTDAMdHCj\BCa�aOMdj>UCw\MdPLDNP ��Ê�BCPAMdg@BTadaOnYDN<>=�?N=�BT?N=¦DGF]HY?N=@BCPAHCjKP�bÑ o�Á�Ê ^_Hl=@P#j\HTD�BC^\^_?A=QPAPEMODNPA=�aOS[DNHZ=�MODA<>=@?#DA<\=�I>?AHJ`>ad=�X HCS�j\BTDAw>?WBTa�axBTj\UCw\BCUC=I\BT?WPLMdj>U�HC?�HTS�UC=@j>=�?WBiDNMOHJj�o[pqDWP�UJHJBTa_MxP-DNH%Mx^_=�j�DAMOS�nkDA<>=�MOj>jKBiDA=�PGDN?Aw\gfDAw>?N=(Mdj<�w\XYBCjZXYMOj\^6F#<>MdgW<�=�j\BC`>aO=QP�B%gW<\MOax^kDAHkBCg�g�w>Md?N=#adBCj>UCw\BCUC=(PAH%= VHC?ADAad=@PNPAaOnJo¥�P3Bz?N=@PAw>aOD MOD3I>?AHJIKH�PL=QP�MODNP S�HJ?AXZBCaOMxPLX�Mdj BzS�HC?NX�S�HC?3F#<>MxgW< j>=@MmDN<>=�?=fe_MdPLDAMdj>U»I\BT?WPLMdj>U¿DAHlHCaxPY^_=��J=�adHCI:=@^�`ln�g�HCXYI>w_DN=�?ZPAg�MO=@j�DAMxPGDWPkg@BTjs?A=QBC^_MdaOn`K=Zw\PA=@^��[j>HJ?�MdP%MmD�g�aO=QBT?�<>HiFÂj>=@F}=��Zg�MO=@j�D%I\BT?WPLMdj>U DA=QgW<>j>M g�w>=@P%g@BTj½`:=^_=@PAMOUJj>=@^vMdj B�PLDA?WBTMdUC<�DLS�HJ?AF�BT?W^�XZBCj>j>=�?Qo�p jËHTDN<>=�?�F]HJ?N^>P6HCj>=¼<KBCPYDNH`K=@UCMdj�Mdj�PLHJXk=�PA=�j\PA=C�>BC`10qMOj>MODAMdH\od>o(;�<>=�Á�Ê DA<>=@HC?Nn�<\BJP#j>HTD�nC=fD�?A=QBCgW<>=Q^ BZPLDNBC`>ad=%=�j>HJw>UC< S�HJ?AX1F#<>=�?N=�HCj\=F]HJw>ad^YMdjl�C=QPGD�DN<>=¦= VHC?AD]Mdj6`>w>Mdad^>MOj>UkB�g�HCXYI>ad=fDA=¦Á�ÊsIKBT?WPL=@?@o�pqD]<\BJP�`:=�=@jgfHCXYXY=�j�DN=@^ � ;(Á�MxP�B�³\=�ax^uF#<>HJPA=Y�C=@?An3S�HJw>j\^>BTDAMdHCj\P�PA<>MOS¬D�BCP�?N=�XYHC?WPL=�0aO=QPAPAaOn�BCP g�w>MdgWt_PNBTj\^ � ´ �(BC^_S�HC?W^�� Ñ ÒJÄCÄJµfo

Ñ oCÒ

Page 182: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ � �������� ����,� � ���f ���$% �!� ��� � ��������!

;�<>=(j\=felD g�w>=@PLDAMdHCjYDN<\BiDEgfHCXY=QP�w>IZj\BTDAw>?WBTadadn�MxP�b�pqS�DA<>=�BT`:Hi�C=#?N=@BCPAHCjKPR<>HCax^F#<ln6PL<\HCw>ax^�y�{c|sF]HJ?AtJ=�?WP-MOjl�J=@PLD]DN<>=�Md?EDAMdXk=�BCj\^6=�:HJ?LD�MOj PGDNw\^_nlMdj>U6Á�Ê ��;�<\=BTjKPLFE=�?�MxP(BCPES�HJaOadHiF(P�bÑ o#pqS�HCj\= MxPYMdjJDN=�?N=@PLDA=Q^zMdjzDN<>=3DNBJPLtzHTS¦BJg�g�=�I_DNMOj>UuHCj\aOn�UJ?NBCXYXYBTDAMxg�BCa�PA=�j30DA=�jKgf=@P�DA<\=�j3BiD]ad=@BJPGDES�HC?EaxBTj>UJw\BTUJ=@P�adMdtC=�Ã�j>UCadMxPL<6F#<\=�?N=�XYHi�C=@Xk=@j�D]I>axB~n_PB¼gf?Nw\gfMxBTa]?AHJaO=J�R=fe>BTXYI>ad=@P�BT?N=6tlj>HiF#j���S�HC?�F#<>MdgW<c� � DA<\=�?N=6MdP�j>H¿jKBiDAw\?NBCaFEB~nkDAH6g@BTI_DNw>?N=�DN<>=�Md?#= V=@gfDNP#Mdj BCjln6HTS[DA<>=�FE=�ada 0qtlj>HiF#j�adHCUJMdg�UC?WBTXYXZBT?WPHC?�=�elDA=�jKPLMdHCj\P�HTS�DA<>=@X �u´�¾lDNBT`\aO=@?@� Ñ ÒJÒ � µ8o¦pqD¦MxP¦j>HTD¦`K=@MOj>U3gfaxBTMdXY=@^¿<>=�?N=DA<\BTD�Á�Ê <\BJP%PABTDAMxPGS�BJg8DNHC?Nn¿PLHJaOw>DAMdHCj\P¦DNH�DA<>=QPL=ZI\?AHJ`>aO=@XZP�`>w_D�BTD�aO=QBCPLD%B�C=�?NnYadBC?AUJ=�jlw>X�`K=@?EHCScad=@BC^>MOj>UkadMOj>UJw>MxPGDWPEBC?A=�F]HJ?AtlMdj>U%HJj�DN<>=@PA=�I\?AHJ`>aO=@XZPMOj»DA<>=�Á�Ê�S�?NBCXk=@F]HJ?At¼BCj\^»HCj>=YFEHCw>ax^¿adMdtC=kDAH3UC=�D�DA<>=Z`:=�j>=�³>D%HTS]DA<>=@MO?= VHC?ADNP#BTjK^�Mdj\PAMOUJ<JDWP�od>o#mË<>=�?N=@BJP�XZBCj�nºHCDA<>=@?ZUC?WBTXYXZBiDNMdg@BTaES�HC?NXZBTadMdPAX =�MODA<>=@?6^_H½j>HTD6BJ^>^_?N=@PNPDA<>=#I>?NHC`\aO=@XYPRHCSVBCj\BTI\<>HC?WB�?N=@PAHCadw_DNMOHJjkBCj\^ gJwKBTj�DAMO³\=�?]PAg�HCI>Mdj>U�HC?�BJPAPAw>XY=DA<\BTD�DN<>=�n¿BC?A=�`K=QPGD�<\BCj\^_ad=@^¿`�n�I\?NBCUCXZBiDNMdg@P���Á�Ê�adMOj>UJw>MxPGDWP�MOjl�C=QPGD¦XYHJPLDHTS�DA<>=@MO?(=�:HJ?LDWP#Mdj3BTDLDN=�XYI_DAMdj>UZDNH6PLHJaO�J=¦DA<>=QPL=%I\?AHJ`>aO=@XZP�w\PLMdj>UYDN<>=�PNBTXY=XYBJgW<>Mdj>=�?Nn�F#<>MxgW<¿Á�Ê <\BCP(^>=��C=@aOHJIK=Q^ S�HC?(<KBTj\^_adMdj>U6F#<10qXYHi�C=�XY=@jJDWP�o���SgfHCw\?NPA=RMmDcX�w\PLD�`K=�BJ^_XYMmDADA=Q^�<>=�?N=RDA<\BTD�DA<\=�n�BJ^>^_?N=@PNP�B��C=@?An¦PLXZBTadaiS�?WBCgfDAMdHCjHTScDN<>=%BTjKBTI><>HJ?NB�?N=@PAHCadw_DAMdHCj�I>?AHJ`>ad=�X3o >Å\o(Ê]=Qg�BCw\PL=�S�HC?�MdXYI>aO=@XY=�j�DAMdj>U¿Á�Ê�I\BC?NPA=�?�HJj>=�<KBCP¦DAH�PLDNBC?LD%BT`30ÎMdj>MODAMdH\��HCj\=DA=�jK^>P�DNH�DNBCMOadHC?�DN<>=�I\BC?NPA=�?%BJg�g�HC?W^_MOj\U�DNH�DA<\=6j>=�=Q^½HTS�DA<\=�j\BTDAw>?WBTa�axBTj30UCw\BCUC=C�K=Co U\od��^_w>=�FE=�MdUC<�DWBTUC=�MxP¦UCMd�C=@j3DAH6DN<>=kaO=�elMxg�BCacI>?NHCI:=�?ADAMd=@P�HTS�<\=@BC^\PHTS(gfHJj\PGDNMmDNw>=�j�DWP%=@BC?Aadn¿=@j>HCw\UC<ºMdjºDA<>=�I\BT?WPA=�?%BTadHCj\U¼F#MmDN<�I>?NMOjKgfMdI>aO=QP�S�HJ?g�BCPA=�BJPAPAMdUCj>XY=�j�D�BTj\^6DA<>=@XYBTDAMxg�?NHCad=�BJPAPAMdUCj>XY=�j�DQ��F#<\MdgW<�MOj�DAw>?Nj�=@j\BT`\aO=QPHCj>=�DNH�I\?AHJIK=@?Aadn BJ^>^_?N=@PNP#DN<>=�I\?AHJ`>aO=@XÆHCS]BTX�`>MdUCw>MODGn�Mdj»BCj¿BTI\I>?AHJI>?NMdBTDA=XYBCj>j>=@?�´�PA=�= m»=@<>?AadM�´ Ñ ÒJÄCÄ�µLµ8o�p jzHTDA<\=�?�FEHC?W^>P@�[`:=@g@BTw\PA=ZDN<>=6DN<>=�HJ?AnuMdPPLMdaO=@j�D�HC?�j>=�w_DN?NBCa�DNH�I\BC?NPAMOj\UZHC?�UJ=�j>=@?NBTDAMdHCj��KI\BT?ADAMxgfw\adBC?AMODA=QP#HTS-DN<>=�j\BTDAw10?NBCa[axBTj>UJw\BTUJ=�gfHJj\gf=@?Aj\=@^¼g@BTj¼`:=YXYBJ^_=�wKPL=kHTS�F#<\MOad=k^>=@PAMOUJj>MOj\U�B�I\BT?WPL=@?F#MmDN<>HCw_D�g�HCXYMdj>UYMOj�DAHZg�HCj��\Mxg8D#F#MODA<3DN<>=�DA<>=@HC?NnCo

��B~�lMdj>U�PA=�=@jZDA<>=¦UCH�BTa:BTj\^YDN<>=�gfHCjKgf=�?Nj\P]HTS[Á�ÊrBTjK^6F#<lnZy�{c|z?A=QPL=QBT?WgW<>=�?WPPA<>HCw>ax^�aOHlHCt�BiD]Á�ʦ�CBiD-ad=@BJPGD-F#<>MdaO=#FEHC?NtlMOj\U�HJjYÃ�j>UCadMxPL<�aOMdtC=#axBTj>UJw\BTUJ=@P@�iF]=�F#MdaOa³\?WPGD#UJMO�J=¦BCj�Hi�C=@?A�lMd=�FËHCScDA<\=�Á�Ê XkH_^_=@a�o-p j�DA<\=¦j\=felD(PL=Qg8DAMdHCj�F]=�F#MdaOa�adHlHCt6BTDÁ�Ê�MdjYXYHC?N=(^_=fDWBTMda���BTj\^kMdjkIKBT?ADAMxgfw>axBT?Q�CBiD�=QBCgW<kHTS:DA<>=#I\?AMdj\gfMdI>ad=@P�BCj\^kXYHl^>w>aO=QP�op ju¾_=@g8DNMOHJj Ñ d_o Å>�VF]=kF#MdaOa-PAw>UCUJ=@PLD�<>HiFÐÁ�Ê�g@BTj¿`:=kw\PL=Q^¿g�HCXYI>w_DWBiDAMdHCjKBTadaOn3S�HJ?I\BC?NPAMOj\UkÃ�j>UCadMdPA<�o;�<>=�`\BCPAMdg�HC?NUJBCj>Mdh@BiDNMOHJj3HTSEÁ�Ê�UJ?NBCXkXZBC?�g�BCj¼`:=YPA=�=@j¼Mdj»À�MOUJw>?N= Ñ d>o Ñ o�pqD<\BJP¦DA<>?N=�=Yad=��C=@adP�HCS]?N=�I>?N=@PA=�j�DWBiDAMdHCjKP�HCS�B3PA=�j�DA=@j\gf=Jb ;0 PGDN?Aw\gfDAw>?N=C��¾�0qPLDA?Nw\gfDAw>?N=BTjK^�{[À;0q?N=�I>?N=@PA=�j�DNBTDAMdHCj�oR|�ÀA0q?A=@I>?N=@PA=�j�DNBTDAMdHCj�MxPEDA<\=%PL=@jJDN=�j\g�=�MmDWPL=@amSGo��� � ��"�����%�,-� � �91'&'")2-��&'����� � �+��" ��������� & ! ������,-"�,-�)"���1'& �-� %)& � ��� 1 �� � ��� <7��"�# ��� � & ����,��+��1'�

���)� %$��� �+��� %7,���%�� ���'<

Page 183: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,� � � � ��� � $ � � �; � Ñ Ñ�'&��54���*��**�� - # - � ' $ -�� /*

� � - ��6���� ��� 68&** ��� -� / � �'*"!8& /�� + ��*��C- �54 ���'&���* �'* / �8+ + *8-�4 �54�*��

� � - ��6���� ��� 68&��

$�� ��� � �%$�� # - #8$ �� ��� ��� � �%$� # - #8$� � � ��� -� /���� - � - $ -� /

$�� � 6 & + 68&'-1& ��'/��'4�*�� ��� � 68& + 6 &'-,& ��8/��54�*��

À�MdUCw>?N= Ñ d_o Ñ b�Á�Ê ��H_^_=�ap j6DN<>=�Á�ÊrXkH_^_=@a:Bkgf?Nw\g�MdBCaK?NHCad=�MxP�I\adB~nJ=@^Z`lnZMdjJDN=�?WBCgfDAMdj>U�PAnlPLDA=@XZP]HCScI>?NMOj30gfMdI>ad=@PkF#<>MxgW<sBC?A=6adMxPGDN=@^sMOjvÀ[MdUCw\?A= Ñ d_oed_o½;�<>=QPL=3PLn_PLDA=@XYP�HTS�I>?AMdj\g�MOI>ad=@PkI>axBCg�=gfHJj\PLDA?WBTMdjJDWP]DA<lw\P�³\aODA=@?AMdj>UYHCw>D(w>j>UC?WBTXYXZBiDNMdg@BTaV?N=�I>?N=@PA=�j�DNBTDAMdHCj\P@o

� � (5/16 ��%'&8*16 +$�%'&-�E/��54�����%8&8*,6 + � �,%'&��'/ �,%'&8*,6 + � *"!8&,6)���E& ��� � �'& *54 �54 �54�*��5- � /8-,&���%'&8*,6�+�5* �����54 �82���%8&8*,6 +�C4 ��'4 �82���%'& *,6 +� *����6'* 7 ��%'& *,6 +

À�MdUCw>?N= Ñ d_oed_b-Á�Ê |�?AMdj\g�MOI>ad=@P;]n�I\Mdg@BTadaOnJ���iBT?NMOHJw\PVI>?NMOjKgfMdI>aO=QP�<\B~�J=RPAHCXY=-I\BC?NBCXY=fDA=@?NP�BJPAPAH_gfMxBiDN=@^�F#MmDN<�DA<>=@X o;�<>=QPL=kI\BT?WBTXY=�DA=�?WP�BT?N=�XY=@BCj�D¦DNH�XZBCtC=�DA<>=ZUJ?NBCXkXZBC? �\=�elMd`>ad=Y=�j>HJw>UC<¿DAH�BCg 0gfHJw>j�D�S�HC?(BTada�DN<>=%^_M :=@?A=@jJD#axBTj>UJw\BTUJ=@P@o

� &Z�'& ( 3� ) � � 5�'%,�$f�(0p jËF#<\BTD�S�HCadadHiF(PZMdP�Bº�C=@?Ans`>?NMO=�S�PAw>XYXZBT?NnzHCS%Á�Ê1I>?NMdj\gfMdI>ad=@P@o pqD�MdP�`\BCPA=@^��I>?NMOXZBC?AMdaOnJ�_HCj ;�wKBT?ADA=Z´ Ñ ÒCÒ � µ8o

Page 184: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ pd �������� ����,� � ���f ���$% �!� ��� � ��������!

� ������ ��� � � � ��� � ���

;�<>=���0q`\BT?�DA<>=@HC?NnsUJMO�J=@PYDN<>=uPLDA?Nw\gfDAw>?N=¼HTS%I\<>?NBJPL=QPZMdj Á�ʦo]pqD ?A=@I>adBJgf=QPZDA<\=I><>?WBCPA=�PLDA?Nw\gfDAw>?N=�?Nw>ad=@PEHTS[=@BT?NadMO=@?�DA?WBTjKPGS�HJ?AXZBiDNMOHJj\BTa:UC?WBTXYXZBT?WP@ocpqD#PAB~n_P�DA<\BTD�MOSDA<\=�?N=�MxP]B�<>=@BJ^/��HK�JMOD�<\BCPEB%XZBie_MdXZBTa:I>?AHCÏG=@gfDAMdHCjYDA=@?AXY=Q^�BCP���o_;�<>=¦XZBie_MOXZBCaI>?NHTÏG=Qg8DAMdHCj¿MdP�B�I><>?WBCPA=�HJI_DAMdHCj\BCaOadn¼gfHJj�DNBTMdj>Mdj>U3B�g�HCXYI>ad=�XY=�j�D�BTj\^»B�PAIK=QgfMO³\=�?BCP�^_=fDN=�?NXkMdj>=Q^3`�n�DA<\=%<>=@BJ^3BTj\^�BCadPAHZIKH�PAPAMd`>aOn BC^~ÏGw\j\g8DWP�o#;�<>MxP�g@BTj3`K=�PGDWBiDA=Q^Mdj½DA=�?NXZP%HCS�?Nw>ad=6PAgW<\=�XZB�BCP�S�HJaOadHiF(P@�[F#<>=@?A=6g�w>?NaOn»`>?NBJgWtC=�DNP�Mdj\^_Mxg�BTDA=YDA<\=�HCI30DAMdHCjKBTadMmDGn6HCS[DN<>=%gfHJj\PLDAMODAw>=@jJDQb

XZBiDN<´IlEÀ]o Ñ µ �� È BC^~ÏGw\j\g8D���´IlEÀ]oedCµ �� È �� BJ^~ÏGw>j\gfD´IlEÀ]o ÅJµ �� È ¾lI:=@g���´IlEÀ]o � µ �� È ��H l]HCXYI>a´IlEÀ]oeqCµ �� È BC^~ÏGw\j\g8D��´IlEÀ]o oJµ �� È �� BJ^~ÏGw>j\gfD;�<>=�HC?W^_=�?kHTS�g�HCj\PLDAMODAw>=@j�DNPkHCjºDN<>= ?AMdUC<�D�<KBTj\^sPLMx^_=�HCS�?Nw>aO=QP�´IlEÀEo Å�µ�BCj\^´ lEÀEo � µ�XZB~n�`K=�adBCj>UCw\BCUC=�^_=@IK=@j\^_=�j�DQ�K=Jo UKoO�>Mdj ��MOj\^>M�l]HCXYI>a[F#MOadacI\?A=Qgf=@^>= ��H\o;�<>MxP¦MdP¦B�PAMdXkI\aO=k=fe>BTXYI>ad=�HCS]B�gW<\HCMxgf=�HCS�I\BC?NBCXk=�DA=@?@o¦;�<>=�HJ?N^>=�?�PL<>HiF#j¿<>=�?N=MxPES�HC?�Ã�j>UCadMdPA<�o

��H�MdP�DA=�?NXY=@^Y<>=QBC^ZBCj\^ �� MdP]MODNP�XZBTelMdXZBTaKI>?AHCÏG=@gfDAMdHCj�o ��H�g@BTjZ`:=�B�ad=fe_Mxg�BCag�BTDA=@UCHC?NnYaOMdtC=�y ´�j\HCw>jKµf�>É ´��J=�?N`Kµ8�>¥ ´�BC^~ÏG=Qg8DAMd�C=~µEHC?#|�´�I>?N=�I:HJPLDAMdHCj:µ�HJ?�MmD(g�BCj`:= B3S�w\j\g8DNMOHJj\BTa#g�BTDA=@UCHC?Nn¿adMdtC=6Mdj��c��l � �¿|�=fDWgToº¾lIK=QgT��l]HJXYI>aEBCj\^�BJ^~ÏGw>j\gfDX�wKPGDE`K=¦XZBie_MOXZBCa\I>?NHTÏG=Qg8DAMdHCjKP�o �(=QBC^6g�HCj�DA?NHCaxP-DN<>=�gW<>HJMdg�=�HCS[¾lIK=Qg�BCj\^-l]HCXYI>a`:HTDA<�PA=�XZBTj�DNMdg@BTadaOn�BJPEF]=@aOacBJP#PLnlj�DNBJg8DNMdg@BTadaOnJo�¡i� Q�l�T�Q���:���¡i�����C� �����K¤E{�=�elMxg�BCa\I>?NHCI:=�?ADAMd=@P�X�w\PLD]`:=�?N=�I>?N=@PA=�j�DN=@^k`lnYg@BiDF0=�UJHC?NMdBCa�PLDA?Nw\g8DNw>?N=»BiD3=��J=�?NnraO=@�C=�a¦HTSkPLnlj�DNBJg8DAMxg¼?N=�I\?A=QPL=@jJDWBiDNMOHJj ´�MÎo =JoO� ;�06BCj\^¾�0 PGDN?AwKg8DAw\?A=J�>BTj\^ {cÀz?A=@I>?A=QPL=@j�DNBiDNMOHJjKµ8o;�<>MxP�I>?NMOjKgfMdI>aO=�F#<>MdgW<ºMxP%j\HTD�B3I\BC?LD�HTS(BTjln¿HJj>=ZHTS�DN<>=�PA=��J=�jºPLn_PLDA=@XYP%HTSI>?NMOjKgfMdI>aO=QP�adMxPGDN=@^�MdjrÀ[MdUCw\?A= Ñ d_oed3=@j\PLw\?A=QP%DN<\BiDYaO=�e_Mdg@BTaE?A=RgJw\MO?N=�XY=�j�DkMOj_S�HJ?AXZB 0DAMdHCj3MxP#I>?N=@PA=�j�D(BiD(=QBCgW< aO=@�C=�acHTS[?N=�I\?A=QPL=@jJDWBiDNMOHJj BCj\^��>XYHC?N=�Hi�J=�?Q�JMOD�BTaxPAHkMdj\PAMdPLDNPDA<KBiD¦DA<>=YMdj_S�HC?NXZBiDAMdHCj»X�w\PLD�`K=ZgfH_^_=Q^¼Mdj¼DN=�?NXYP¦HCS]gfHJj_³\UCw\?NBTDAMdHCj\BCacI:HJPAMmDNMOHJj\P��BYgW<>HCMxgf=�F#<>MxgW< MdP#jKBiDAw\?NBCaVS�HC?(Ã�j\UCadMdPA<10qaOMdtC=¦adBCj>UCwKBTUC=QP�o

� ������� � ������ � �� � � �

����� ¡i���@��¡i���:��¤Ñ o#pqS 5 MxP�BCjkBC?AUJw>XY=�j�D-HTS � DN<>=�jkDN<>=#IKH�PLMODAMdHCjZ|uH_g�g�w>I>Md=@^k`ln 5 MxP-BCPNPLMdUCj\=@^HCj>=�BTjK^�HJj>aOn�HCj>= � 0q?NHCad=�� cd>o#pqS � <\BJP]B � 0q?AHJaO=��rDAHYBCPNPLMdUCjc�CDN<>=�j�DA<>MxP � 0Î?NHCad=�MxPEBCPNPLMdUCj>=Q^YDAHkB%I:HJPAMmDNMOHJj|vBCj\^ |sMxP#H_g�g�w>I>Md=@^�`ln�HCj\=�BCj\^�HCj>adn�HJj>=�BT?NUCw>XY=�j�DQo

Page 185: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,� � � � ��� � $ � � �; � Ñ TÅy(HCDA=�DN<\BiD¦MOj¿Á�Ê DN<>=�HJ?An � 0Î?NHCad=@P�BT?N=%BCPNPLMdUCj\=@^�DAH�PAnlj�DNBCgfDAMxg�I:HJPAMmDNMOHJj\P�BCj\^j>HCD�^_MO?N=@gfDAadnZDAHZBC?AUJw>XY=�j�DNP@o��j>=�HTS�DA<\=�XZBTMdj�g�HCj\PA=2g�w>=@j\gf=QP�HTScDA<>= � 0qg�?AMODA=@?AMdHCj�MdP�DA<\BTD�g�HCj\PLDAMODAw\=�j�DNPEBT?N=BTadadHiF]=Q^YDAHYXYHi�C=�DAHYj>HJj10�DN<>=�XZBTDAMxg�I:HJPAMmDNMOHJj\P�HCj\aOnJo�´�;�<>MxP�MdP#BkPLMdXYI>ad=�=fe>BTXYI>ad=MdaOadw\PLDA?WBiDAMdj>UZgfHJj\PLDA?WBTMdjJDWPEHCj3XYHi�C=�XY=@jJD�MdXkI:HJPA=@^ `ln�PAn_PGDN=�X HCS�I>?NMdj\gfMdI>ad=@P@o µ

� ������� � ��� �� ��� "� �

ÊE=fS�HJ?A=�FE=�^>=f³\j>=�UJHi�C=@?Aj>XY=@jJDQ�JFE=�F#MdaOa�^_=�³\j>=%PAHCXY=�PGDN?AwKg8DAw\?NBCa�?A=@adBTDAMdHCj\P@o� �J�R�����@���K� � � �J�K¢z¢��>����¤ 5 ­ « ­W¸�j jZ®i¶ ±�� � M ´�B�µ 5 ^_Hl=@P�j\HTD�^_HJXkMdj\BTDA= � �\BCj\^´�`:µ]DA<>=�³\?WPLD(`>?NBCj\gW<>Mdj>Ukj>H_^_=�DA<\BTD�^_HCXYMdj\BiDN=@P 5 ^>HCXYMOjKBiDA=QP � o� �J�R�����@���K��� � �C�:¢�¢��>���]¤ 5 j « ­N¸ j!jZ®i¶ ±�� � M ´�B�µ 5 ^_Hl=@P�j\HTD�^_HJXkMdj\BTDA= � �\BCj\^´�`:µE=��C=@?An�XYBTe_MOXZBTa�I\?AHCÏG=@g8DNMOHJj6DN<\BiD�^_HJXYMOj\BTDA=QP 5 BTaxPLHZ^_HJXYMOj\BTDA=QP � o� �J�R�����@���K���f�V�Q��¡� :�l�[�:¤(¾»ª ¶ Ì ¨ ¹ hi¨ ¶ ¨�E`K=�DGF]=@=�j 5 BCj\^ � M ¾ ^_HCXYMdj\BiDN=@P 5 BCj\^ ^_Hl=@P#j>HCD(^_HCXYMdj\BiDN= � o� �J�R�����@���K��� �[¡i�l����¢������_¡�[£�� � :�J¡i��¢��l�V�C¤ 5���¸ hi¨ ¹8¶ � � M �b´�B�µ 5 MxP#BY<>=@BJ^ c´�`:µ 5 X 0qg�HCXYXZBTj\^>P � �\BTj\^´�gQµ]DA<>=@?A=�MxP�j>HYMdjJDN=�?N�C=@j>MOj\UkXZBTelMdXZBTa�I>?NHTÏG=Qg8DNMOHJj�`:=fDGFE=�=�j 5 BCj\^ � o¥�?N=��lMdPA=@^ ^_=�³\j>MODAMdHCj�BTj\^�HCj\=¦FE=�F#MdaOa�w\PA=�MxP#BCPES�HCadadHiF(P�b� �J�R�����@���K� � � :�J¡i��¢��l�V�C¤ 5���¸ hi¨ ¹8¶ � � M �b´�B�µ 5 MxP#BY<>=@BJ^ c´�`:µ 5 X 0qg�HCXYXZBTj\^>P � c\BTj\^´�gQµ]DA<>=@?A=�MxP�j>HYMdjJDN=�?N�C=@j>MOj\Uk`KBT?N?AMd=�?�`:=fDGFE=�=�j 5 BCj\^ � omË<>=@?A=�`\BC?A?NMO=@?�MdP(^>=f³\j>=Q^3BCPES�HCadadHiF(P�b� �J�R�����@���K�� k�_¡~¡i����¡l¤�� ®i¹8¹ ª�¨ ¹ MdP�B�XZBTelMdXZBTa�I>?NHTÏG=Qg8DNMOHJj�PAw\gW< DA<\BTD´�B�µEMmD(MxP�j>HJj10 � 0ÎXZBT?NtC=Q^ c´�`:µEMdP�S�w\aOadn�PAIK=QgfMO³\=@^½´�M�o =Co-MODNP(PAI:=@g�I:HJPAMmDNMOHJj�MxPE³\adaO=Q^\µ9c:BTj\^´�gQµEMmDWP#<>=QBC^�MdP(B�S�w>jKg8DAMdHCjKBTacg@BiDA=@UCHJ?AnJo�#=@XYBC?AtVbZ;�<>= gf?Nw\gfMxBTa]Md^_=QB¼`:=�<>Mdj\^zUCHi�C=@?Aj\Xk=@j�D%MdP�DAHu^_=f³\j\=6DA<\=�^_HJXYBCMOjzHTSMdj��\w>=@j\gf=�S�HJ?(B�<\=@BC^�o

Page 186: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ � �������� ����,� � ���f ���$% �!� ��� � ��������!

� �J�R�����@���K� �¡i� ����¡ � � K��¡i�[¢z���V�J¤ 5 k:¹A¸'k ¨ ¹ §¯Í ��¸ hi¨ ¹8¶ � � M Ñ o(Ã�MODA<>=@?#MmD(MxP#BkaO=�elMxg�BCa�UCHi�J=�?Nj>XY=�j�D@��DA<KBiD(MxP�b

² 5 UJHi�C=�?Nj\P � cKBCj\^² 5 MxP(BkaO=�e_Mdg@BTa�<>=QBC^

d>o#HC?Q�[MODkMxPkBTj�BTj�DN=@gf=Q^_=�j�DkUCHi�C=@?Aj\Xk=@j�D@�cMdjzF#<\MdgW< 5 UCHi�J=�?Nj\P � =�e>gf=�I>D�MOD^_Hl=@PZj>HCD6?A=Rg�w>MO?N= 5 DNHº`K=»Bº<>=@BJ^���MmD g�BTjr`:=¿B½XZBie_MdXYBCa(I>?NHTÏG=Qg8DAMdHCjco�(HiFE=��C=@?@� 5 X�w\PGD(`:=%gfHp0ÎMdj\^_=�e_=@^�F#MmDN< � o

� ������� � �� ! � �� � ���� �?�Q���#�����@��¡l¤´�M¬µ�Ã��J=�?Nn6y�|rF#MODA<3I><>HJj>=fDNMdg�g�HCj�DA=@jJD(X�w\PLD�`:=%g�BJPL=�XZBT?NtC=Q^�o´�MdM¬µ�Ã��C=@?An6BC?AUJw>XY=�j�D(y�|�´�^>MdPLDAMdj\g8D�S�?AHJX |�����µ]X�w\PLD(`:=%g�BCPA=¦XYBC?AtJ=@^�o� �?�Q� � ���@� �K��¢��l�V�C¤ lEBCPA=�MxP(BCPNPAMOUJj>=@^�`�n gf=@?LDWBTMdj�<>=QBC^>P�=Jo UKoÑ o#�C=�?N`�BJPAPAMdUCj\P�BCg@gfw\PNBiDNMO�J=�g�BCPA=Cod>o#I>?A=@IKH�PLMODAMdHCj3BCPNPAMOUJj\PEHC`>adMDg�w>=�g@BCPA=CoÅ\o#MOj�� ���¦¥(Á � �cBCPNPAMOUJj\PEj>HCXYMdj\BiDNMO�J=�g@BCPA=Co

�¡i�����C� �����K¤�lEBCPA=�MdP#BJPAPAMdUCj>=Q^�w>jK^_=�?#UJHi�C=�?Nj>XY=�j�DQo� ������� � ��� ��� ��� ���� � �������� Q�>�C�l��� -¤(y(HZMdj\PLDNBCj\gf=�HTS���Hi�J= 0 5 g@BTj�gf?NHJPNPEXYHC?N=�DN<\BTj3HCj\=¦`KBT?N?AMd=�?Qo� ������ � � � � � � � ������ � � � ��� ����� � � �� � � ��

�¡i�����C� �����K¤�¥(ada�DN?NBJgf=@PEX�w\PGD(`:=�I>?NHCI:=�?NaOn�UCHi�C=@?Aj\=@^�o� ������� ��� ������� ��� � ���� �J�R�����@���K�� k�����[�����[¤ 5�� ª ¶ ±�� � M Rb´�B�µ 5 g90 gfHJXYXYBCj\^>P � c\BCj\^´�`:µ 5 BTj\^ � BT?N=�gfHp0ÎMdj\^_=�el=Q^ k�����[����� �¡i�����C� �����E�J¤

Page 187: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,� � � � ��� � $ � � �; � Ñ pq´�B�µ�¥(j�BTjKBTI><>HJ?A=¦X�wKPGD(`:=�`KHJw>j\^ Mdj�MODNP#UJHi�C=@?Aj>Mdj>Ukg�BiDN=�UJHC?NnCo´�`:µ�¥�I>?AHJj>HCXYMdj\BTa�X�w\PLD�`:=�S�?N=�=�Mdj MODNP�UJHi�C=@?Aj>Mdj>UYg�BTDA=�UJHC?NnCo´�gQµ�¥(j#� 0q=fe_I>?N=@PNPLMdHCj�X�w\PLD(`:=�S�?A=@=¦=@�C=@?AnlF#<>=@?A=Joy(HCDA=Jb �(=@?A=J�[À>?N=�=YXY=@BCj\P�MOD�PL<\HCw>ax^uj>HTD%`:=Z`KHJw>j\^u`ln»B I:HTDA=@j�DAMxBTa�BC?AUJw>XY=�j�DI:HJPAMmDNMOHJj�o� �J�R�����@���K� � � :�J¡i������� � �_�@��:�\¡�-¤5 MxP�DA<\= �J¸ h~¨ ¹8¶ ª ¶ ��­W® Ì ¨ �J¸T¹ ͦS�HC? � M 5 MxP�DA<\=�XkMdj>MdXZBTa�XZBie_MdXYBCa�I>?NHTÏG=@gfDAMdHCj3gfHJjJDWBTMdj>Mdj>U\b´�B�µ �´�`:µ]DA<>=�UJHi�C=�?Nj>HJ?]HCS � �\BCj\^´�gQµ�BZ¾ ��Ê���Ã�lE;� �J�R�����@���K� ��� ���� � "Z¤�¥��� �� �����3MxP�b=�MODA<\=�?(¥(Á � F#MmDN<3?A=QPLI:=@gfD#DAHYMOj �c�HC?(BYPAw>`_ÏG=Qg8D�y�|vF#MODA<3?N=@PAIK=Qg8D#DAHZy�|�P#BTjK^ PAXZBTada�gfaxBTw\PA=@P@o;�<>=�DNBC`>aO=QP�UCMd�C=@j�`:=�adHiF MOjK^_Mdg@BiDN=¦F#<KBiD#MmDN=�XZP#BT?N=�BTj\BCI><>HC?N=�BCj\^6F#<KBiD(BT?N=I>?NHCj>HJXYMOj\BCa�o-;�<>=@n6Mdj\gfadw\^_=�ad=fe_Mxg�BTa�g@BiDN=�UCHJ?AMd=@P�BJP�F]=@aOa�BJP�=�XYI_DGn�g@BiDN=�UCHJ?AMd=@P@o

�'&��54��,/ 7 � /�� &�2'*,6541&'- - � + � + � / �8&�2'*,6'4,&'-$868*��5*��A4-�5/ 7 $86'*��5*��A4 �5/ 7

� � � �/ � � � � � ��� � � � ��� � � � ��� � � � � � � ��� � � � ��� � � � ��� � � � ��� � � � * * * * * */ � * � * %C4��A-,&87 * * � * $���� * #%$ � ��6'/�,& *+ * * &�� � * * * *% * � � � � ��� � � � ��� � � � ��� � � � * * � � ��� � � � ��� � � � ��� � � � ��� � � ** * * + 68* + &�6 * * * 0 % � � 68/�,& *6 � * %C4�� * �5* ��� * � * + 6'* *�� � � 6'/��,& *4 * &�� � * &�� � * * * *� � � � � ��� � � � ��� � � � ��� � � � � � � ��� � � � ��� � � � ��� � � � ��� � � �

� ������� � � � ������ � � � � � ��� � "� �

Ê�BCPA=@^¿HCj»DA<>=6BC`KHi�J=�I>?NMOjKgfMdI>aO=QP���DA<>MxP�MxP�F#<\BiD�FE=Yg@BTjuPAB~n¼BC`KHJw_D�XkHi�J=�XY=�j�DWP´ ;�w\BC?LDN=C� Ñ ÒCÒ � µ8bÑ o#mË<\BiD(g�BCj3`K=�XYHi�C=Q^��

² ��j>adn6<>=QBC^>P(BCj\^�XYBTe_MOXZBTa�I\?AHCÏG=@g8DNMOHJj\P�BT?N=¦S�?A=@=�DNHZXYHi�C=Cod>o#mË<>=�?N=�g�BTj�DA<\=@PA=�`K=�XYHi�C=Q^��

Page 188: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ o �������� ����,� � ���f ���$% �!� ��� � ��������!

² ;�<>=�axBTj\^>MOj>UZPAMmDN=�<\BCPEDNHY`K=%Bkj>HJj10�DN<>=�XZBTDAMxg�IKH�PLMODAMdHCj�o² ¥ <>=@BJ^�g�BCj�HJj>aOnY`:=�XYHi�J=@^YDNHkBCj>HTDN<>=�?E<>=@BJ^6I:HJPAMmDNMOHJj�BCj\^6B�XYBTe^0MdXYBCa�I>?NHTÏG=Qg8DAMdHCj g�BCj HJj>adn6`K=�XYHi�J=@^�DAHZBYXZBie_MOXZBCa�I>?AHCÏG=@gfDAMdHCj�I:H 0PAMmDNMOHJj�o

Å\o(Ê]n�F#<\BiD#I>?NH_gf=@PNP#g�BCj BkXYHi�C=@XY=�j�D#Hlg@gfw>? �² pqS�DA<\=�DWBT?NUC=fD]IKH�PLMODAMdHCjZMxP]BCjZ=�XYI_DGnZPAIK=Qg(HC?]<>=@BJ^ZI:HJPAMmDNMOHJjYDA<>=@j6DA<\=I>?NH_gf=@PNP�MxP�HTS-PLw>`KPGDNMmDNw_DAMdHCj3=�axPA=¦MOD(F#MdaOa�`:=�`ln�BC^iÏGw>j\g8DNMOHJj�o

� o �(HiF S�BC?�BTIKBT?ADZg@BTjËB½XYHi�C=Q^sg�HCj\PLDAMODAw>=@j�D�BTj\^vMODNPYDN?NBJgf=�`:=�� ;�<>MxPZMdPBTj\PAF]=@?A=Q^6Mdj\^_Md?A=Qg8DNaOn6`ln�DA<>=�S�HJaOadHiF#MOj\Ukg�HCj\^_MODAMdHCjKP�b² ¾lw>`>ÏLBCgf=@j\gfnVbEp j¼B6PAMOj>UJaO=�PGDN=�I�j>H6XYHi�J=�XY=�j�D�g�BCj¼gf?NHJPNP#XYHC?N=�DA<\BCjHCj\=¦`KBT?N?AMd=�?Qo² Ã�lE|�b>¥(ada�DA<\=�DA?WBCgf=QPEX�w\PLD(`K=�I\?AHJIK=@?Aadn6UCHi�J=�?Nj>=@^�o² ÊEMOjK^_MOj\U¿DN<>=�HJ?AnVbZ¥(jvy�| 0ÎDA?WBCg�=6X�wKPGDY`K=�`KHJw>j\^zMOjsMmDWP�UJHi�C=@?Aj>Mdj>Ug�BTDA=@UCHC?NnzBCj\^rBºF#<10ÎDA?WBCgf=º´�MOjËUJ=�j>=@?NBCa���B½�iBT?NMdBC`>aO=~µkX�w\PLD�j>HCD�`:=`:HCw>j\^ Mdj3MmDWP#UCHi�J=�?Nj>MOj\U�g�BTDA=@UCHC?NnCo

� &Z�� � 5 �Â"%2 ) � � ��$ � �@2 " "�+-0R��2����p j�BCj%Ã�j>UJaOMxPL<30ÎadMOtJ=�axBTj>UJw\BTUJ=-F#<>=�?N=�I>?NMOXZBC?An�MOj_S�HJ?AXZBTDAMdHCj%BT`:HCw>DcDA<\=�XZBiDNMdg�?AHJaO=QPMxP�g�Hl^>=@^ºMdj�DN=�?NXYP�HTS(?N=�axBiDNMO�J=6IKH�PLMODAMdHCjsBTj\^ºnJ=fDkMmDZBTaxPLH¿IK=@?AXYMODNP�XkHi�J=�XY=�j�DWPS�HC?�DAHJI>Mxg�BTadMdh@BiDNMOHJjº=fDWgTod�-MmDkMdP�j>HTDZ^_M �6gfw>aOD�DNH»PA=�=6DN<>= MOXYI:HC?ADNBTjKgf=6HCS(�~BC?AMdHCwKPgfHJj\PLDA?WBTMdjJDWP�HCjzXkHi�J=�XY=�j�D%F#<>MxgW<z^_Md?N=@g8DNaOn»S�HCadadHiF}S�?NHCX �iBT?NMOHJw\P%I\?AMdj\gfMdI>ad=@P�HTSÁ�ÊËDN<>=�HJ?AnJo;[Hº`K=@UCMdjËF#MmDN<��(HCj\=�XkMdUC<�D�PAw>UJUC=@PLDZDA<\=�S�HCadaOHiF#Mdj>U�PLDA=@I\PZS�HJ?�I\BC?NPAMOj\U½BCjÃ�j\UCadMdPA<�adMdtC=�adBCj>UCwKBTUC=JoÑ o���PAMOj>U ��0q`\BT?kPLn_PLDA=�X HCS(I>?AMdj\g�MOI>ad=@P�DAH¿S�HC?NX,I\<>?NBJPABCa]g@BiDA=@UCHJ?AMd=@P�HJjºDA<\=`\BCPAMdP�HTS�aO=�elMxg�BCa]<\=@BC^\P�o�;�<>MxPYPGDN=�IvXZB~n½BCUJBCMOj�`:=3`>?NHCtC=@jºw>IvMOj�DAH»DA<\=S�HCadaOHiF#Mdj>UYPLw>`30qPLDA=@I\P�b

² �#=QgfHCUJj>Mdh�=�aO=�e_Mdg@BTa�<>=QBC^>P@o² ¾l=QBT?WgW<ZS�HC?EDA<\=¦adHCj\UC=@PLD�F]=@aOa 0�S�HJ?AXY=Q^6PL=Rg�w>=�j\g�=�HCS[PAIK=QgfMO³\=�?WP�BTj\^ BiDF0DNBJgW<YMmD�´�M�o =Cod��XYBCtC=#MOD]B�PAMdPLDA=@?Wµ[DNH�DA<>=(I\<>?NBJPABCa>g�BTDA=�UJHC?Nn�^_HJXkMdj\BTDAMdj>UDA<\=�aO=�elMxg�BCa�<>=@BJ^�o² y(HJj10 ^_=fDN=�?NXkMdj>MxPGDNMdg@BTadaOn�I>?AHJIKH�PL=¦I:HJPNPLMd`>ad= ��P#BCP#g�HCXYI>ad=�XY=�j�DWP�o

d>o���PAMOj>U�DA<>= � 0qg�?AMODA=@?AMdHCj BCj\^rI>?NHTÏG=Qg8DAMdHCjËI\?AMdj\gfMdI>ad=C�(Mx^_=@jJDNMmS�nvDN<>=¿j>=@=@^_=Q^=�XYI_DGn�g@BiDA=@UCHJ?AMd=@PEMdj�DN<>=%PK0qPLDA?Nw\g8DNw>?N=Co;cH%^_=QgfMx^_=#DN<>=#DGnlIK=�HTS�=�XYI_DGn�0 g�BiDN=�UJHC?Nn�HCj>=(XZB~n�w\PL=(DA<>=#S�BJg8DWP-HTSVS�HCadadHiF 0MOj>UYtlMdj\^�o

Page 189: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�,� � �3� �!� � ���� � �� ��A ��� ���K�^��� �� Ñ ² pqS�DN<>=�I:HJPAMODAMdHCj�MxP]j>HTD�I>?NHCI:=�?NaOnkUCHi�J=�?Nj>=@^YMODEX�w\PLD]`:=¦Bk|����}´¬S�?NHCXÃ�lE|Eµ8o² pqS#DA<\=6IKH�PLMODAMdHCjº<KBCP%B�g@BCPA=6BCPNPLMdUCj>=Q^»DAH¼MOD@�RMOD�X�w\PLD�`:=�B3�iBT?NMxBT`>ad=DA?WBCg�=Co#´¬S�?NHCXÆj>HCj3y�| 0ÎXYHi�J=�XY=�j�DWµfo

Å\o���PAMOj>UY`>Mdj\^_Mdj>UkDA<\=�HC?Nn¿´�MOj�g�BJPL=¦HTS-|������lw\PAMOj\UYg�HCj�DA?NHCa:DN<>=�HJ?An>µ�³\j\^�DA<\=gfH 0qMdj\^_=fe_=Q^6I><>?WBCPA=Cop jsg@BCPA=�HCS�B�DA?WBCg�=C��^_=�DA=@?AXYMdj>=�MODNP�UCHi�J=�?Nj>Mdj>U 0 g�BTDA=�UJHC?NnV�cBTj\^�DA<>=@j^_=@IK=@j\^_Mdj>U¿HJjºDA<>=�S�BCgfD�F#<>=�DA<>=@?�MOD�MxP�BCj�y�| 0�DN?NBJgf=6HJ?�B��iBT?NMxBT`>ad=adH�HJt S�HC?�DA<>=YBTj�DA=Qgf=Q^_=�j�D�MOj�DN<>=kUCHi�C=@?Aj\MOj>Up0qg@BiDN=�UCHJ?AnZHJ?�HJw_DNPAMx^_=�MOD@�?N=@PAIK=Qg8DAMd�C=@aOnJoy(HCDA=¦DA<KBiD#DA<\=%^_HCXZBTMdj HTS-PL=QBT?WgW<�j>=@=@^ j>HTD(g�?AH�PAPEXYHC?N=¦DA<\BCj HJj>=�`\BT?N?NMO=@?@oÀ>HJaOadHiF#Mdj>UZBT?N=%PLHJXk=�=�e>BTXYI>ad=@P�S�?NHCX ¾_BTMdj�DK0 ;�Mdh�Md=�?�´ Ñ ÒJÒ � µEF#MODA<¼PAHCXY=�0ÎF#<\BTDPAMOXYI>adMm³K=@^�¾�0 PGDN?Aw\gfDAw>?N=�F#<>MxgW<�MdaOadw\PLDA?WBiDN=�DA<>=%BCI>I>?NHJBCgW<coÑ o����l���_�Q�! :� � ���?� �@���J�K� ���@¡8�[�C�@���:�]¤�;�BTtJ=�DN<>=�=fe>BCXkI\aO=Jb;�<>=�`KHin6F#<\H ��HC<\BCj�XY=�D(nC=@PLDA=@?N^\B~nkMxP(g�HCXYMOj\U�DNHCXYHC?N?NHiF¾�0qPLDA?Nw\gfDAw>?N=�HCS�?N=�axBiDNMO�J=¦g�adBCw\PA=¦Mdj DA<>=%BC`KHi�J=�MxP@b� ������� ��� B�� ����� � ��� � � ��� � B ������� � ���! "�#� �y(HTDN=�DN<>=�=�XYI_DGn%g@BiDA=@UCHJ?An�MxP[j\HTD-B�| � �r`K=Qg�BTwKPL=EMmD-MxP�I>?AHJIK=@?Aadn�UCHi�J=�?Nj>=@^BTj\^3MOD�MxP�j>HCD�BTj¼y�| 0ÎDA?WBCg�=�`K=Qg�BTwKPL=%MOD�<\BJP�BJg�gfwKPABTDAMd�C=%g�BJPL=%BJPAPAMdUCj>=Q^�`lnDA<>=(�J=�?N`�o-¾lH�MmD�g�BCj>j>HTD�`:=(`:HCw>jK^Y`�nYBTj6BC?AUJw>XY=�j�D-IKH�PLMODAMdHCj6g�H 0qMOjK^_=fe_Mdj>UMmD(F#MODA< I F#<>H I>PNBiDNMdPL³\=@P#BCaOaVDN<>=%gfHJj\PLDA?WBTMdjJDWP�o

d>o ��?���@� K� � �:���@��¡8���T�Q���:��¤p j g@BCPA=¦HCS�IKBCPNPLMd�C=QP���S�HCadadHiF#MOj>UYBC^\^_MmDNMOHJj\BTa�BJPAPAw>XYI_DNMOHJj\P#BT?N=�XYBJ^_=Cb² ¥�I\BJPAPAMO�lMdh�=Q^��J=�?N` g@BTj>j>HCD(BCPNPLMdUCj g�BCPA=¦DAHYMODNP#HJ`_ÏG=@gfD#y�|Ro² � 0qUC?NMd^k?N=2g�w>Md?A=@XY=�j�D-HTS�B�I\BCPNPLMd�C=E�C=@?A`Z^_M V=�?WP-MOjkDN<>=�S�HCadaOHiF#Mdj>U�XZBTj30j>=@?�S�?AHJX DA<KBiD(HTSRBTj3BCgfDAMd�C=��C=@?A`�o´�BJµ�y(H � 0Î?NHCad=�MdP�BCPNPLMdUCj>=Q^�`ln BYI\BCPNPLMd�C=��J=�?N`�DNH6MmDWP(PAw>`_ÏG=@gfDK0 y�|rMdj^^0 PGDN?AwKg8DAw\?A=´�`Kµ ¥HG `�n�0 gfHJXkI\aO=@Xk=@j�D,IlF#MmDN< DA<>= � 0q?AHJaO=¦HTS[DA<>=%PAw>`_ÏG=Qg8D(y�|vHCScDA<\=BCgfDAMd�C=��C=@?A`3g�BCj�`:=�HCI>DAMdHCj\BCaOadn6I>?N=@PA=�j�D(BiD(^^0 PGDN?AwKg8DAw\?A=Jo

l]HCj\PAMd^>=�?#BCP#BCj�=�e_BCXYI>aO=Jb¥ `:HlHCt�FEBJP�DN<>?NHiF#j�o� � �$� � � �!��% � B � &��� � �'�!�� � � ��� � B � �

�(=�?N=C��DA<>= DA?WBCg�=�MxPZBTjvy�| 0�DN?NBJgf=�`:=@g@BTw\PA= MmDZMxPYMOjrB¿I:HJPAMODAMdHCjvF#<>MdgW<sMdPI>?AHJIK=@?AadnuUCHi�C=@?Aj\=@^u`>w_DZ^_Hl=@Pkj>HCD�<\B~�J=�B¿g@BCPA=Coº¾lH¿MODkX�w\PLDk`:=�`:HCw\j\^MOjuMmDWP�UCHi�J=�?Nj>MOj\U�g�BTDA=@UCHC?Nn3F#<>MxgW<»MxP¦DA<>=ZPA=�j�DA=@j\gf=YMODNPA=�aOS�BCj\^�DN<>=6y�| MdjPLw>`>ÏG=@g8D#I:HJPAMmDNMOHJj3`>MOjK^>P#MOD�BTI>I>?NHCI\?AMxBiDN=�adnCo

Page 190: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ TÄ �������� ����,� � ���f ���$% �!� ��� � ��������!

Å\o�� ����Q�l�T� � �Q� � �,����Q�l�T�Y¡i�>� �@�����l]HCj\PAMd^>=�?EDA<>=�=�e>BTXYI>ad=�PA=�j�DN=�j\g�=�`K=@aOHiF F#MmDN< MODNP�¾�0qPLDA?Nw\gfDAw>?N=Cb��HC<\BCj PA=�=@XZPEDAHY`K=�HJj DAMdXk=Jo

� B � � E � ����� � B � ��� � � � ��� �� � �!� � � B � � � � � � � �%� � � ��� � � �

¥(UJBCMOjkDN<>MdP�MdP�B%g�BJPL=#HCSVy�| 0qXkHi�J=�XY=�j�D�`:=@g@BTw\PA=#MmDEg�BTjYj>HCD�UC=�D]g�BJPL=ES�?NHCXBTjuMOj���F#MODA<n0 ¥(Á �}S�=@BiDNw>?N=C�[PAH�MOD%XkHi�J=@P¦DNH3B3j\HCj10 � 0qXYBC?AtJ=@^¿IKH�PLMODAMdHCj�oy(HTDN= I PL=@=�X Il^_Hl=@P]j>HTD � 0qXYBC?AtkMODNP�PLw\`_ÏG=@gfD]I:HJPAMmDNMOHJj�o#´�pqD#PL=@=�XZP �¼HC<\BCj6MdPHCj�DAMdXk=Jo µ� &Z� � �Â5k23!($�,30R�f5�2mu=�<\B~�J=�`>?NMd= �\n�PAtC=fDWgW<>=@^�DA<>=ZÁ�Ê DA<>=@HC?Nn3MOj¿DA<>MxP�gW<\BTI>DA=�?Qo�À[Mdj\BCaOadnC��FE=�<\B~�J=UCMd�C=@j¼PLHJXY=%DA=@j�DNBiDNMO�J=�PAw>UCUJ=@PLDAMdHCj\P�BT`:HCw_D¦<>HiF�MmD�g�BCj¼`K=�MOXYI>ad=�XY=@jJDN=@^¼S�HC?�BCjÃ�j\UCadMdPA<6adMOtJ=(adBCj>UCwKBTUC=Jo[pqD#PA<>HCw>ax^Z`:=�XY=�j�DNMOHJj>=@^6DA<\BTD]?N=@gf=@j�DAadnZÁ�ÊsDN<>=�HJ?AnY<\BJP`:=�=�j�PAw>I:=�?WPL=Q^_=@^�`ln6DA<\=¦j\=�F XkMdj>MdXZBTadMdPLD(I>?NHCUC?WBTXYXY=¦HTS l]<\HCXZPLtlnJo

����������� ������������

;�w\BT?ADA=�´ Ñ ÒJÒ � µ#MdP¦BTj�=�e_g�=�adaO=@j�D¦PAw>XYXYBC?An HTS]Á�Ê DN<>=�HJ?AnNc:F]=�PLDA?NHCj\UCadn�?N=@g 0HCXYXY=�jK^zMODYDAH½y�{c|}I:=�HCI\aO=3F�BTj�DAMdj>U»DAHuaO=QBT?NjzXYHC?N= BC`KHJw_DkDA<>=¼Á�Ê DN<>=�HJ?AnJol]<>HJXYPAtlnº´ Ñ ÒJÄ Ñ µ�MdP�DN<>=�HJ?AMdUCMdj\BCac?N=fS�=�?N=�jKgf=C�V`>w>D��J=�?Nn ^>M �6gfw\amD�DAH�?A=QBC^�w\j>aO=QPAPHCj\=EMxP-BTad?N=@BC^>n�S�BTXYMOadMxBT?-F#MODA<kDA<>=#MxPNPLw>=QPR`K=@MOj\U%BC^>^_?N=@PNPA=@^�o ��BT=@UC=@XYBCj�´ Ñ ÒCÒ Ñ µcMdPBY`:=fDLDN=�?�PLHJw>?Wgf=¦S�HC?�?A=QBC^_Mdj>UZBT`:HCw_D�Á�Ê DN<>=�HJ?AnJo]É�BCj �#MO=@XZPA^_M ÏGt =fD�BCa�o�´ Ñ ÒCÄpo�µBTjK^�(BC^lS�HJ?N^�´ Ñ ÒJÄCÄJµYBC?A=¿=fe>gf=@aOad=�j�D�BCj\^r<>MdUC<>adns?N=@BJ^>BT`\aO=¼PAHCw>?Wgf=QPZHCj UC?WBTX 0XZBT?��lMO=@F]=Q^6S�?NHCX DN<>=�I:=�?WPLI:=@gfDAMd�C=¦HTS l]<\HCXZPLtln�BTj Á¦=@j>=�?WBiDNMO�J=¦Ã�j�DA=�?NI>?NMdPA=Co ��SgfHJw>?WPL=J�JDN<>=�n�DNBCtC=¦DA<>=@MO?�=fe>BTXYI>ad=@P�XZBTMdj>adnZS�?NHCX Ã�j>UCadMdPA<�o

�JHCw>?Nj\BTalHCS��-ª ¶ � �_ª �WÌΪ ­��8¶�� �_ª ¹ Í�I>w>`\aOMxPL<\=@^k`ln ��pG;v|�?N=@PNP��^lEBTX�`\?AMx^_UC=�MxPRDA<\=I>?NMOXZBC?An6PAHCw>?Wgf=�F#<>=@?A=�?N=@PA=@BC?NgW<>=@?NP�MOj¼Á�Ê I>w>`>adMdPA< DA<>=@MO?�F]HJ?AtVomuHC?Nt�HCj�Á�ÊvI\BC?NPAMdj>U�<\BCP�`K=@=�j6I\w>`>adMdPA<>=@^YMdj�¾_BCMOj�DF0q^_Mdh�Md=�?EBTj\^6¾_h�I\BCtCHiF#Mxgfh´ Ñ ÒCÒ � µ8�^mu=�<>?NadM�´ Ñ ÒCÄCÄ�µ8�_ÊE=�?NF#MdgWt�=fD�BTaÎo#´ Ñ ÒCÒ Ñ µ8�_=�DNgTo;�<>MxP[gW<KBTI_DN=�?�MdP[`\BCPA=@^�HCj ;�w\BC?LDN=�´ Ñ ÒCÒ � µ�BCj\^�¾_BCMOj�DF0 ;�MOh@MO=@?�BCj\^�¾_h�I\BCtCHiF#Mxgfh´ Ñ ÒCÒ � µ8oEpqD�F�BCP(HC?NMOUJMOj\BCaOadn6I>?N=�IKBT?N=@^�S�HC?¦BYDAw_DNHC?NMdBCa�HCj¼y�{c| BTD ��y�Ã]¾ l ��dTj\^

�#=@UCMdHCj\BCa m»HJ?At_PA<>HCI HCj l]HCXYI>w>DA=�?�|�?NHlg�=@PNPLMdj>UkHTS�¥�PAMxBTj�{cBCj>UCw\BCUC=QP¦´�ÊE<\BT?WBiDNM=fD�BCa�od� Ñ ÒJÒrdT`Kµ8o

Page 191: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��������� ���

� � � � � ����� � � � � ����� � �

pqDRMdP�BT?NUCw>=Q^�Mdj�DA<>MxPRgW<\BTI>DA=�?[DA<KBiDRXYBCjln¦HCS_DA<>=�^_M :=@?A=@j\gf=QPc`:=fDGFE=�=@jkÁ�ʽBTjK^�DA<\=|-BTj\MOj>MxBTj¼BCI>I>?NHJBJgW<¼PGDN=�X S�?NHCX ^_M :=@?A=@j\gf=QP�Mdj¼DN<>=�Md?�UJHJBCadP@omË<>Mdad=�DN<>=�S�HJ?AXY=@?DA?NMd=@PRDNH�BTj\PAFE=�?-F#<ln�gW<>Mdax^_?A=@jZBT?N=�BC`>ad=#DAH%BJg�g�w>Md?A=�axBTj>UJw\BTUJ=�PAH�= VHC?ADAad=@PNPAaOnJ�TDA<\=|-BTj\MOj>MxBTj»BTI>I>?NHJBJgW<¿BC^\^_?A=QPAPA=@P�<>HiF Mdj_S�HJ?AXZBiDNMOHJj¿MxP�gfHJj��J=�nJ=@^3w\PAMOj\U axBTj\UCw\BCUC=`ln�BYPLI:=@BCtC=@?�DAHZBkaOMxPGDN=�j>=@?@o� �6��� ��2k7�+-5�'%,3!E7R�f5k2;�<>=�I>?AHJ`>ad=�X1DA<\BTD�<\BJP(Mdj�DA?NMOUJw>=@^�UJ=�j>=@?NBTDAMd�C=�adMOj\UCw>MxPGDWP�MxP�<>HiF BZ<lw>XZBTj¿gW<\MOax^MxP�BT`\aO=�DAH�BJg�g�w>Md?A=�j\BTDAw>?WBTa[adBCj>UCwKBTUC=�F#MODA<\HCw_D�BTjln6S�HJ?AXZBTacDA?WBTMdj>Mdj>U�PAMOXYI>adn�`ln=fe_I:HJPAw>?N=3DAHzB½XYMdj>MdPNgfw\aO=¿BCXYHCw>j�D�HCS=G I:HJPAMmDNMO�J=5I�axBTj>UJw\BTUJ=¼^>BiDWB>o�;�<>=�nvI:HJPK0DAw\adBTDA=6DN<\BiDkDA<\=�?N=6X�w\PLD�`:=3B�w>j>Md�C=@?NPNBTa]UC?WBTXYXZBT?%=@�C=�?Nn½gW<>MOax^ºMxP�`:HC?Nj�F#MODA<��BTjK^½F#<>MdgW<ºUJ=fDWP%Mdj\PGDWBTj�DAMxBiDN=@^»DAH»B�I\BT?ADAMxgfw\adBC?%UC?WBTXYXZBT?�S�HJ?�DA<>=�adBCj>UCwKBTUC=kDNHF#<>MxgW<ZDA<\=�gW<>Mdad^6MdP�=fe_IKH�PL=Q^�o-;�<>=(UJ?NBCXkXZBC?�BTadaOHiF(P-DA<>=�gW<>Mdad^kDNH�^_=�DA=�?NXYMOj\=(DA<\=UC?WBTXYXZBiDNMdg@BTadMmDGnZHCS�PA=�j�DA=@j\gf=QP�o;�<>=�UJHJBTa�HCSRDA<>=%UJ=�j>=@?NBTDAMd�C=�=�j�DN=�?NI>?AMxPA=¦MxP#DNH6gW<\BT?WBCgfDA=@?AMdh�=�DA<>=�MOj>MODAMxBTa�PGDWBiDN=HTSVtlj>HiF#ad=@^_UJ=]HCS:axBTj>UJw\BTUJ=�DN<\BiD�BCaOadHiF(PRB¦<�w\XYBCjZgW<>MOax^�DAH�BCg2g�w>MO?N=EDA<>=#axBTj\UCw\BCUC=PAH�=�:HJ?LDNaO=QPAPAaOnZ´�`�n�<\MdPRHJ?[<>=@?RMOj�DAMdXZBiDN=�BJPAPAH_gfMxBiDNMOHJj�F#MmDN<kB¦PLI:=�=QgW<�g�HCXYX�w>j\MmDGn>µ8o;�<>MxPEMdP�BCPNPAw>XY=@^YDNH�`:=¦^>MdPLDAMdj\g8DES�?NHCX�HTDN<>=�?�gfHJUCj>MODAMd�C=¦PGDN?AwKg8DAw\?A=QP�Mdj6DN<>=�XYMdj\^�op j�gfHJjJDN?NBJPGDEDAH6BC`KHi�J=C��DA<\= gJw\=@PLDAMdHCj DA<\BTD(<\BCP�Mdj�DA?NMOUJw>=@^3|-BCj>MOj\MdBCj\PEMdP@�><>HiFMxP�MOD�DN<\BiD�B�PAI:=@BTtJ=�?�MdP¦BT`>ad=%DNH g�HCjl�C=@n�Mdj_S�HJ?AXZBiDNMOHJj�DAH B6<>=QBT?N=�?�`�n3XY=@BCj\P�HTSj\BTDAw>?WBTa�axBTj\UCw\BCUC=Co �(HiF�MxP#DN<>=�Mdj_S�HC?NXZBiDNMOHJj�DN<\BiD�BZPLI:=@BCtC=@?(FEBCj�DNP�DNH�gfHJj��J=�nJ�?N=�I>?N=@PA=�j�DA=Q^kHC?]g�H_^_=@^ZMdj6axBTj>UJw\BTUJ=C�CBCj\^Z<>HiFrMxP�DN<>=�<\=@BT?N=�?]BT`>ad=#DAH�=felDA?WBCgfD�DA<\=Mdj_S�HC?NXZBiDAMdHCjco�;�<>=�UCHJBCa_HTSVDA<\=�|-BTj>Mdj>MxBTjY=�j�DN=�?NI>?AMxPA=EMxP-DNH�gfHJj\PLDA?Nw\g8D�B¦DN<>=�HJ?An�HTS<lw>XZBTj½gfHJXkX�w>j>Mxg�BTDAMdHCjuw\PLMdj>U3j\BTDAw>?WBTa-axBTj>UJw\BTUJ=CoZÁ¦?NBCXYXYBC?@��B I\BC?LD�HCSEPAw\gW<BkDA<\=�HC?Nn�HCS�gfHCXYX�w>j>Mxg�BiDNMOHJj��>MxP�BZPAn_PGDN=�X1HTSR?Aw>ad=@P(DA<\BTD�=@PLDNBC`>adMdPA<>=@P�BY?A=@adBTDAMdHCj`:=fDGFE=�=�j¿F#<\BiD�DA<>=kPLI:=@BCtC=�?¦^_=@g�Md^>=@P#DNH�PNB~n BCj\^�<>MxP�w_DLDN=�?WBTj\g�=C�VBTj\^¼PAMdXkMdaxBT?NaOnJ�DA<\=�w_DLDN=�?WBTj\g�=�BCj\^�DA<>=�XY=QBTj>Mdj>UZBk<>=@BC?A=@?E=�elDA?WBCg8DWPES�HC?NX MOD@o

Ñ iÒ

Page 192: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Ä � �������� �"� �1���#� $% ��#���! " � �%�����

;�<>=6XZBTÏGHC?%DWBCPAt¿S�HJ?%DN<>=6DN<>=�HJ?An»MOj�UJ=�j>=@?NBTDAMd�C=Z=@jJDN=�?NI>?NMdPA=6MxP�DAHugfHJ?A?N=@gfDAadngfaxBCPNPAMmS�nvPL=@jJDN=�j\g�=@P6BJPZUC?WBTXYXZBiDNMdg@BTa�HC?�w>j>UC?WBTXYXZBiDNMdg@BTaÎo ��=QBTj>Mdj>U�gfHJXY=@PZMdjDA<\?AHJw>UC<¼g�HCMdj\^_=fe_Mdj>U6HJ?(DA<\=fDNB�BCPNPLMdUCj\Xk=@j�D�`>w_D�BiD�DNMOXY=QP��VXY=@BCj>MOj\U�BTj\^¼UC?WBTX 0XZBiDNMdg@BTadMmDGn%XZB~n�`:=#BiD-�iBT?NMdBCj\gf=Jo[À>HJ?-=fe>BTXYI>ad=C�iMdjZBTj\BCI><>HJ?NB\�~g�HCMdj\^_=�elMdj>U�PL<\HiF(PF#<\BTD¦DN<>=YUC?WBTXYXZBT?�IK=@?AXYMODNP2ccHCj»DA<\=kHCDA<>=@?�<\BTj\^���DA<>=@?A=YBT?N=kt�j\HiF#j»gfHJj�DA=felDWPF#<>=@jkB¦gfHJMOj\^>=fe_MOj\U�j>HCD-IK=@?AXYMODLDA=Q^�`ln�DN<>=�DA<>=@HC?Nn�MdP-BJg�gf=@I_DA=Q^%`ln%j\BTDAMd�C=�PLI:=@BCt�0=�?WP@o1´Î¾l=�=��:?NMO`>M 0 �(=�?ADAhv´ Ñ ÒCÄCÒ�µkS�HC? =fe>BCXkI\aO=QP�o µ ¾_w\gW< Mdj\PGDWBTj\g�=@P BT?N=¿j>=@MmDN<>=�?MdjJDN=�?N=@PLDAMdj>U�j>HJ?�?A=@aO=@�iBTj�D�S�HC?�DA<>=�DA<>=@HC?Nn�BCg@gfHJ?N^_Mdj>U¦DAH muBJPLHiF�´ Ñ Ò iÒ�µ8o�;�<>=(MdX!0I>adMdg@BiDNMOHJj�HTS�PLw\gW<�B�I:HJPAMmDNMOHJj�MxP]DA<\BTD�B�I\BT?WPA=�?�`KBCPA=@^ZHJj6DA<\=�DN<>=�HJ?AnYXZB~nY?A=LÏG=@gfDBTjK^6DN<�wKP#`>adHlgWtYS�w\?LDN<>=�?(I\?AH_gf=QPAPAMdj>U�HCSRBYPA=�j�DA=@j\gf=�F#<>MxgW<�XYMdUC<�D#`K=%BJg�g�=�I_DWBT`>ad=Mdj�DN<>=�UCMd�C=@j g�HCj�DA=�elD@o;�<>=�XZBTMdj�DWBCPAtYS�HC?�DN<>=�|-BTj>Mdj>MxBTj6DN<>=�HJ?An�MdPEDNHYBJPAPAMdUCj�B�XY=@BCj>MOj\U�DNHZBkPA=�j30DA=@j\gf=kF#<>MxgW<¼MxP�DN<>=YPABCXk=kBCP�DA<\BTD�BJPAPAMdUCj>=Q^3`�n3DN<>=k<>=@BC?A=@?@o�¾lw>`10 ^_Md��MxPAMOHJj¼MOj�DNHPA=�I\BC?NBTDA=kaO=@�C=�axP¦MdP�B�DA<\=�HC?Nn¼Mdj�DA=�?Nj\BCa�XZBTDLDA=@?%BCP¦adHCj>U3BCP¦DN<>=YXk=QBTj>Mdj>U�BCPNPAMOUJj10XY=�j�D�?N=�XZBTMdj\P�DN<>=�PNBTXY=CoR;�<>=�?N=#MxP�gf=@?LDWBTMdj>aOn�j>H%PA=�I\BC?NBTDA=#BTw_DNHCj>HJXYHCw\P-PAnljJDWBCg 0DAMxg%ad=��J=�a[IKH�PGDNw>adBTDA=Q^3`�n DN<>=�DA<\=�HC?NnCo#p j¼S�BCg8DQ�\DN<>=�|-BCj>Mdj>MdBCj�;�<>=�HJ?An �lMO=@F(P#DA<\=?WBTj>UJ=�S�?NHCX DA<>=%PA=�j�DA=@j\gf=�DNHYDA<>=�XY=QBTj>Mdj>UZBCP(g�HCj\PAMxPGDNMOj>UYHCS�ad=��J=�axP�HTSRXk=QBTj>Mdj>UK�=@BJgW<�aO=@�C=@a[XYHC?N=%?N=f³\j\=@^3DN<\BTj�DN<>=�I\?A=@��MdHCwKP(HCj\=Co�;�<\=�=@BC?Aadn aO=@�C=�axP@�:g@BTadacDN<>=�X�lnJBCt~BC?NBCj�aO=@�C=@adP@�VXYBCtC=�XkMdj>MdXZBTa-w\PA=�HCS�F]HJ?Aax^�tlj>HiF#ad=@^_UJ=�BCj\^¼UJ?A=QBiDA=@?�w\PA=kHTSXYHC?NI><>HJaOHJUCMxg�BTaRHJ?%tiBT?WBTtiB t�j\HiF#aO=Q^_UC=Jo�;�<>=6axBiDN=�?%ad=��J=�axP�XYBCtC=ZUJ?A=QBiDA=@?�w\PA=ZHTSFEHC?Nad^Ztlj>HiF#ad=@^>UC=C��MdjJDN=�j�DAMdHCjKP]HCS�DA<\=�PAI:=@BTtJ=�?EBTj\^�<>=@BC?A=@?@��=fDWgTo-pqD�MdPEMdXkI:HC?ADNBCj�DDAHYXY=�j�DNMOHJj�<>HiFE=��J=�?Q�CDN<\BiD#=��J=�j�DA<>=��lnJBCt~BC?NBCj6ad=��C=@adP]w\PA=¦DA<>=�j>HCDAMdHCj�HCS[�lMd�~BCt�0PA<\BYHC?(PAIK=QBTtJ=�?��lMO=@F#IKHJMOj�D(F#<>MxgW<3<\BCP(BY?N=�axBiDNMOHJj�DNHZMOj�DN=�j�DAMdHCj\P�HJ?(I>?WBTUJXYBTDAMxg�P@oÀ�MOUJw>?N= Ñ Å>o Ñ PL<>HiF(P¦DN<>=Z�lnJBCt~BC?NBCj¿ad=��J=�axP�MOjº^_=�DNBTMdaÎ�[BTjK^»`:=@PAMx^_=@P�DN<>=@PA=C��PL<\HiF(PHCj\aOnZDN<>=�³\j\BCa�XY=@BCj>MOj\Ukad=��J=�a�BJP�IK=@?Ng�=�Md�C=@^�`lnZDA<\=�<>=@BC?A=@? �TPLI:=@BCtC=�?Qo��� � -,&�� /���54�� 7�& !8&87 � 0 %5/����,%'&* - + &8/ �5&,6 %5/8- 4 � �A4 �� ****��� � �C/16'/ �C/ 7,& !8&87**��� � !54 ( %5/ � �'4 7�& !8&87**��� � - � 6 *'/�,&�7,& !8&87

� �����8&�68&�� -,& ��8&����,&

À�MdUCw>?N= Ñ Å>o Ñ bR{�=@�C=@adP�Mdj DA<>=%|-BCj>MOj\MdBCj�XYH_^_=�a

Page 193: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �3� �r� ���!��� � � ��#�f��� � Ñ Ä Ñ;�<>=�Á�ÊsXYH_^_=@a��lHCj6DA<>=�HTDA<\=�?E<\BTj\^���MxPEPL<>HiF#jZMdj�À�MdUCw>?N= Ñ Å>oed_o �(=�?N=C�JDA<\=�?N=

�'&��54���*��**�� - # - � ' $ -�� /*

� � - ��6���� ��� 68&** ��� -� / � �'*"!8& /�� + ��*��C- �54 ���'&���* �'* / �8+ + *8-�4 �54�*��

� � - ��6���� ��� 68&�

$�� ��� � �%$� # - #8$ � ��� ��� � �%$� # - #8$� � � ��� -� /���� - � - $ -� /

$�� � 6 & + 68&'-1& ��'/��'4�*�� ��� � 68& + 6 &'-,& ��8/��54�*��

À�MdUCw>?N= Ñ Å>oed_b�Á�Ê ��H_^_=�aBT?N=kDA<>?N=�=Zad=��J=�axP�HTS�?N=�I>?N=@PA=�j�DNBTDAMdHCj»S�HC?�B3PA=�j�DA=@j\gf=Jb ;0qPLDA?Nw\g8DNw>?N=C�-¾�0qPLDA?Nw\gfDAw>?N=BTjK^�{cÀA0q?A=@I>?A=QPL=@j�DNBiDNMOHJj�o¿;�<>=3|�ÀA0q?A=@I>?N=@PA=�j�DNBTDAMdHCj½MdP�DA<\= PA=�j�DA=@j\gf=Jo»;�<>=@?A=�MdPBTaxPAH¦B�I>?NHl^>w\g8DNMOHJj�gfHJXYIKHJj>=�j�DRDA<\BTD-UC=�j\=�?WBiDA=QPc?N=�I\?A=QPL=@jJDWBiDNMOHJj\P[BTD�;0 PGDN?Aw\gfDAw>?N=Co;�<>=@?A=�MdP#BkPLMdUCj\Mm³Kg@BTj�D#^_M V=�?N=�jKgf=¦`K=�DGF]=@=�j6DN<>=¦DGF]HkXYH_^_=�axPEF#<>MdgW< MxPEPAHCXY=�0DAMdXY=@PkXYMdPNPA=@^�Mdj�DN<>=3^_=fDWBTMdadPkHTS�aO=@�C=�axP@oup jzDA<>=�Á�Ê XYH_^_=�aÎ��MODYPA=�=@XZP%DN<\BiDZMODMxP(DWBCgfMODAadn3BCPNPLw>XY=Q^ DA<\BTD�XY=@BCj>MOj\U6MdP¦BTj G HC`>ÏG=@g8DNMO�J=5IK=��C=@j�D�HC?�=�j�DAMODGn3HCw_DF0�DN<>=�?N=MdjzDN<>=3F]HJ?Aax^�F#<>MxgW<vMdPY?N=�I>?N=@PA=�j�DN=@^�`lnºXY=@BCj\PYHTS�DA<>=3DN<>?A=@=�ad=��J=�axPYHTS�?N=�I\?A=�0PA=�j�DNBTDAMdHCj\P@o�p j�DA<>=Z|-BCj>MOj\MdBCj�XkH_^_=@a��VDN<>=kXk=QBTj>Mdj>U�MdP�B6XY=@jJDWBTaRHC`>ÏG=@g8D�Mdj¼DA<\=XYMOjK^�HCS\DN<>=#PLI:=@BCtC=�?R?N=�axBiDNMOj>U�DA<\=#HC`_ÏG=Qg8DAMd�C=E=��J=�j�D-HC?R=�j�DNMmDGn%F#MODA<kDN<>=(PLI:=@BCtC=@?,I P�lMO=@F#IKHJMOj�D¦MmDQo�;�<>MxP�g�HCXY=@P�BT`:HCw_D�F#MODA<¿DA<>=�FEB~n�DA<>=�DNB�?AHJaO=QP�BTjK^3t~BC?NBCtiBY?AHJaO=QPBT?N=�gfHJj\gf=@MO�J=@^6Mdj DA<>=�DGFEHYXYHl^>=�axP�opqDYMdPYMdj\PLDA?Nw\g8DNMO�J=�DNHug�HCXYI\BT?N=�DA<>=3ad=��C=@adPkBCg�?AH�PAP�DA<\=�DGFEHuXkH_^_=@adP@oz;[Hu^>HPAH�MmD�MdP�MOXYI:HC?ADNBTj�D6DNH�Mx^_=�j�DAMOS�nr?A=@adBTDAMdHCj\PA<>MdI\PZ`:=fDGFE=�=@j PLHJXk=¿tC=�nvg�BTDA=�UJHC?NMO=QPBTjK^�?N=�axBiDNMOHJj\P(BJgf?NHJPNP�DN<>=%XYH_^_=�axP@oE;�<>=�DWBCPAt�MxP(<\BC?N^>=�?�DA<KBTj3MmD¦PL=@=�XZP#`:=@g�BCw\PA=DA<\=¿DN=�?NXkMdj>HJaOHJUCnrBTj\^rDN<>=uXkH_^_=@a�S�HJ?�DN<>=uUC=�j\=�?WBiDAMd�C=¿=�j�DA=@?AI>?NMxPL=¼MxP�MOj\PAI>Md?A=Q^`ln�B¼I:HJPAMmDNMOHJj\BTaEaxBTj>UJw\BTUJ=�PAw\gW<zBCPkÃ�j\UCadMdPA<���F#<>=@?A=QBCP%DA<\BTDkS�HJ?�DN<>=3|-BTj>Mdj>MxBTj=�j�DN=�?NI>?AMxPA=¼MdP�Mdj\PLI\MO?N=@^Ë`lnËBºS�?N=�=»F]HJ?N^rHJ?N^>=�?6axBTj>UJw\BTUJ=Co p j S�BCgfD@�(Mdj\gfHJ?A?N=@gfD=2g�w>Md�iBTad=�j\g�=@P�`K=�DGF]=@=�jrDA=@?AXZP�<\BCPZ`:=�=@j BºXZBiÏGHJ?�PAHCw>?Wgf=�HCS�g�HCj_S�wKPLMdHCjËF#<>Mdad=gfHJXYI\BT?NMOj\UYDA<>=�DGFEHZXYH_^_=�axP�o(À�Md?NPLD@�KtiBT?WBTtiBY?AHJaO=QP(BT?N=%^_M :=@?A=@j�D(S�?AHJX DN<>=�XZBTDAMxg?NHCad=@P@o À\HC?�=�e>BTXYI>ad=C��t~BC?LDWB�tiBT?WBTtiB UC=�DNP%XZBCI>IK=Q^uDAH¿BCUC=@jJDQ�[Mdj\PLDA?Nw>XY=�j�D@�-BCj\^I\BTDAMd=�j�D(?A=QPLI:=@gfDAMd�C=@aOnZMdj�PL=@jJDN=�j\g�=@P�´ Ñ µ8�[´PdCµ�BCj\^u´�ÅJµf�>`:=�adHiF�o��� #$�%'&)('*,+�* + &��'&�����%'& 7 *����9��� #$�%'& �'&�+�* + &��'&�����%'& 7 *����9��� #$�%'& 7�*��� * + & �'&�� 9

Page 194: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Ä�d �������� �"� �1���#� $% ��#���! " � �%�����

��BT?WBTtiB�?N=�axBiDNMOHJj\P�gfHJX�`>Mdj>=�DA<>=�j>HTDNMOHJjZHTS��lMO�iBCtlPA<\B�HJ?]PAIK=QBTtJ=�?��lMd=�F#I:HCMdjJDEF#MmDN<DA<\=fDNBY?NHCad=@P@oÀ>w\?LDN<>=�?Q��BCg@gfHC?W^_Mdj>U�DNH»w\P�DA<\=3PAH 0 g�BCaOad=@^½UJ?NBCXYXYBTDAMxg�BCa�S�w>j\gfDAMdHCj\PYPAw>`_ÏG=Qg8D@�HC`>ÏG=@g8D%=�DNgCo6BT?N=YBTD%�lMO`><KBTt�DAM-ad=��J=�a�MdjuDA<>=6|-BCj>MOj\MdBCj»XYH_^_=�aÎo6;�<>=@n¿<\B~�J=k`:=�=@jS�?N=2g�w>=�j�DNaOn�PAHCw>UJ<JD�DAH�`K=Y^_=f³Kj>=@^»BCP�B ^_MxPGDNMOjKg8D�aO=@�C=�a�`:=fDGFE=�=�j»g�BCPA=�BCj\^3DN<>=fDWB?NHCad=@P@o}pqD�PL<\HCw>ax^Ë`:=»j>HCDA=Q^ËDA<KBiD�PLw>`>ÏG=@g8DQ��HJ`_ÏG=@gfD�<\B~�J=»BT?NMxPL=@jËHCw_D3HTS�I:HJPAM 0DAMdHCjKBTa�axBTj>UJw\BTUJ=@P�adMOtJ=6Ã�j>UJaOMxPA<uF#<\=�?N=YDA<>=@n»<\B~�J=ZBTj½MOj�DNw>MmDNMO�J=�BTI\IK=QBTa�BJP�F]=@aOaBCP�jKBiDAw\?NBCaRBCj\^uPLMdXYI>aO=Z^_=�³\j>MODAMdHCj\P�BTj\^¿DA=QPGDWP�oYp j»S�?A=@=kFEHC?W^¼HJ?N^>=�?�adBCj>UCwKBTUC=QPadMOtJ=�p j\^_MxBTj�adBCj>UCwKBTUC=QP��CDA<>=�PNBTXY=�Mdj_S�HC?NXZBiDNMOHJj6MdPEgfHJj�DNBTMdj>=Q^ZMOj g�BJPL=�=�j\^_Mdj>U�P�HJ?I:HJPLDK0qIKH�PLMODAMdHCj\BCacHJ?�I>?N=�I:HJPAMODAMdHCj\BCacXZBT?NtC=@?NP@o�l]HCjKgf=�I>DNP�HTS�PAw>`_ÏG=@gfD@�VHC`>ÏG=@g8D�BCP�B^_MxPGDNMOjKg8D%ad=��C=@a�BT?N=�j\HTD%HCj\aOn¼w\j>MOj�DNw>MmDNMO�J=Y`>w_D�BTaxPAH MOD%MxP��C=�?Nn¼^_M �6gfw>aOD�DAH¼g�HCXY=w>IºF#MODA<�g�?AMODA=@?AMxB HC?�DN=@PLDNP�S�HJ?�^_=QgfMx^_MOj\U�F#<>=�j�PAHCXY=fDN<>Mdj>U�MdP�B�PLw>`>ÏG=@g8DQo��¼HJPLDBiDADA=@XkI>DNP�DA?Nn�DNH¦^_=�³\j>=EDA<\=�X}g�HCj_³KUCw>?WBiDNMOHJj\BTadaOn�S�HC?�S�?N=�=�FEHC?W^%HC?W^_=@?[axBTj>UJw\BTUJ=@P@�BiD#F#<>MxgW<3IKHJMOj�D#DN<>=�UC?WBTXYXZBT?E`>w>Mdad^>MOj>UZ?Nw>j\P�Mdj�DAH6PA=�?NMOHJw\P�^_M �Zg�w>aODAMd=@P@opqSRF]=%^_?WB~F BYI>Mxg8DNw>?N=�MOj\g�HC?NIKHJ?NBTDAMdj>U�DA<>=%BC`KHi�J=¦Mdj\PAMOUJ<�DNP@�>F]=�<\B~�J=¦DA<>=�I>Mxg90DAw\?A=�PA<>HiF#j�MdjvÀ�MdUCw>?N= Ñ Å>o Å>o�pqD6PA<>HCw\ad^z`K=3XY=�j�DAMdHCj\=@^s<>=�?N=�DN<\BiDZXZBTjlnzÁ�Ê� � � �E&8/��C4-�82*** ��� � � � ��� ��%'&��8/ 6'* 7�&'- � � � � ��� � � � �� � � �C/,6'/ �5/ 7�& !8&87 � � � �**� � � !54 ( %5/�� �54 7�& ! &87 � � � ��� � � � ��� � - � (���& � � � *1(���& � � � � � ��� � �**� � � -,& ��8&����,&

$5/��C4-�C4�/�� 7�&"!8&878- � � $8&,6 �A- /���� ��%'&'4 6�7�& !8& 78-

À[MdUCw\?A= Ñ Å\o Å\b �#=�axBiDNMOHJj\PL<\MOI\P�`:=fDGFE=�=@j�DN=�?NXZP�MOj DA<\=�DGF]HYXYH_^_=�axPDA<\=�HC?NMxPGDWP#F]HJ?AtlMdj>UkHCj3p j\^_MxBTj3axBTj>UJw\BTUJ=@P#^_=�³\j>=%PAw>`_ÏG=@gfD�Mdj3PAw\gW<�BYF�B~nZDA<\BTD�MODDAw\?Aj\P�HJw_D#DAHZ`:=�XYHC?N=�HJ?#aO=QPAPEDN<>=%PNBTXY=�BCP�tiBT?ADNB\o;�<>=@?A=�MxP-BTj>HCDA<>=@?�^_M V=�?N=�jKgf=#Mdj�DN<>=�gfHJj\gf=@?AjKPcDN<>=�DGFEH¦XYH_^_=@adPR<\B~�J=EDAHiF�BT?W^>PS�HC?NXZBTa[IKHiFE=�?(HCS�UC?WBTXYXZBT?WP�o#¾lMdj\gf=�DA<>=�UC=@j>=�?WBiDNMO�J=�=�j�DA=@?AI>?NMxPL=�F�BTj�DNP(DAH gW<\BT?F0BCgfDA=@?AMdh�=�DA<>=�w\j>MO�J=�?WPABCaVUC?WBTXYXZBT?]DA<\BTD(=��C=@?AnZ<lw>XZBCj�MxP�`KHJ?Aj F#MODA<��_DN<>=�?N=�MdP#BCjBiDADA=@XkI>D�DAH�w\PA=�BZUJ?NBCXkXZBC?#S�HC?NXZBTadMdPAXÆF#MODA<»BCP(adMODLDAad=%S�HJ?AXZBCacI:HiF]=@?�BCP�IKH�PAPAM 0`>ad=Co-;�<>MxPEF]HJw>ad^6=�j\PAw>?N=(DA<KBiD]MOD�UC=�j\=�?WBiDA=QP�HJj>aOnkDN<>=�UJ?NBCXYXYBTDAMxg�BCaKPA=�j�DA=@j\gf=QP�Mdjj\BTDAw>?WBTa:adBCj>UCwKBTUC=QP���BTj\^�j>HkXkHJ?A=Jo�;�<\=¦|-BCj>MOj\MdBCj�BTI>I\?AH�BCgW<ZMxP�j>=@w_DA?WBTa:DNH�PAw\gW<gfHJj\gf=@?AjKP�o

Page 195: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �3� � �.��f$%$%���� Ñ ÄJÅ;�<>=(|-BCj>MOj\MdBCj�XYH_^_=�a\S�H_gfw\PA=@P-HJjYt~BC?NBCtiB�?NHCad=@P@�CF#<>Mdad=#XYBTÏGHC?-?N=@PA=@BC?NgW<�= VHC?ADMdjrÁ�Ê�MxPkHCjrBTj\BCI><>HJ?NB¼BCj\^ gJwKBTj�DAMO³\=�?WP@os¾lH»DA<>=@n�`KHCDA<v<\B~�C=3PAHCXY=fDN<>MOj\U¿DNHH�V=�?Qo�pqDkPA<>HJw>ad^�`K=�j>HTDN=@^��R<>HiFE=��J=�?Q�cDN<\BiDkÁ�ÊÂMdj\gfadw\^_=QP�HJj>adn»?N= �\=�e_MO�J=@P%BCj\^?N=@gfMdI>?NH_g�BTaxP�HCw>D%HTS(BTada-DA<\=6IKH�PAPAMd`>aO=6BCj\BTI\<>HC?WB>o�;�<\=@PA=�BT?N=ZB DAMdj�n»S�?WBCg8DNMOHJj½HTSDA<\=�DNHTDNBCa�o �¼HC?N=�Hi�C=@?@�TDA<>=¦DA<\=�HC?NnZ^_Hl=@PEj>HCDEUJMO�J=(DA<\=�?N=fS�=@?A=@jJDEHTS�DN<>MxP�?A=QPGDN?AMxg8DN=@^gfaxBCPNP#HCS-BCj\BTI\<>HC?WBk`>w_D�?WBiDN<>=�?�Md^_=@j�DAMO³\=@P�BZ^_HCXZBTMdj�F#MODA<>Mdj�F#<>MxgW<3DA<>=�?A=�S�=�?N=�j�D<\BJPEDAHZ`:=�S�HCw>j\^�o

� �6�'& *-,�. . "�+R9mu=»UJMO�J=¿`:=�adHiF Bzg�HCXYI\BT?NMxPLMdHCjËHCSkÁ�Ê BTj\^ |-BTj>Mdj>MxBTj BCI>I>?NHJBCgW<ËMdj DWBT`>w\adBC?S�HC?NXZBiDQo�pqD�PAw>XYXZBT?NMOh@=@PEDN<>=%BT?NUCw>XY=@jJDWPEUCMd�C=�j3BT`:Hi�C=Jo

� ¸'k ª ­ � ¨ ¶ ¨ ¹N® ÌΪih~¨ � ¶ Ì ¨ ¹ k:¹ ª ��¨ � ®i¶ ª ¶ ª ®T¶ � kpk:¹N¸@®J­N·��HTDNMO�iB 0DAMdj>Ug�w>=@PLDAMdHCj

�(HiFuMxPVDA<>=]gW<>MOax^�BT`\aO=RDNH(BCg90g�w>Md?A=�axBTj>UJw\BTUJ=�� �(HiFrMxP-DA<\=�PLI:=@BCtC=@?�BT`>ad=�DAHgfHJj��J=�n�MOj_S�HJ?AXZBTDAMdHCj3DAH�DA<>=<>=@BC?A=@?�w\PLMdj>UZaxBTj>UJw\BTUJ=��

Á¦HJBCa ¾�DNw\^_n HCS�Mdj>j\BiDN=ËBTj\^ÂBTw10DAHJj>HCXYHJw\P�PLDA?Nw\gfDAw>?N=@P MdjDA<\=¿<lw>XZBTj XkMdj\^ ?A=@adBTDAMdj>UDAH�adBCj>UCwKBTUC=(S�BCgfw\amDGnZBCPE^_MxP�0DAMdj\gfD�S�?NHCX HCDA<>=@?�g�HCUJj>MmDNMO�J=PLDA?Nw\g8DNw>?A=QP

¾�DAwK^_n HCSsaxBTj>UJw\BTUJ=ÂBJP�BXY=@BTjKP�HTS-gfHCXYX�w>j>Mxg�BiDNMOHJj

;[BJPLt ;�<>=@HC?Nn PA<>HCw>ax^ gfaxBCPNPAMmS�nPA=�j�DA=@j\gf=QP BJP�UJ?NBCXYXYBTDAMxg�BCaBTjK^�w>j\UC?WBTXYXZBiDAMxg�BCa;�<>=�HJ?AnkPL<\HCw>ax^Y=fe_I>axBTMdjYDA<>=I>?NHlg�=@PNP HCS�UJHCMdj>U*S�?NHCXXY=@BTj\MOj>U DNH3PA=�j�DN=�j\g�=@P�BTjK^�lMdg�=��C=�?WPNB

À>H_gfwKP pGPAHCaxBiDA=QP BCj\^ PLDAw\^_Md=@PPAn�j�DWBie l]HCX�`>MOj\=@PZPAn�j�DWBie���PA=�XZBTj10DAMxg�P%BCj\^uI>?WBTUCXZBTDAMxg�P¦MOjºBCjHi�C=@?NBCaOa:S�?WBTXY=�FEHC?Nt���C=@?NBCaOaXYHl^>=�a p j\^_Md?N=@g8D gfHJj>j>=@gfDAMdHCj `:= 0DGFE=�=�j�PAw>?AS�BCgf=rS�HJ?AX ´�|]À;0?N=�I>?N=@PA=�j�DNBTDAMdHCjKµ�BTj\^�Xk=QBTj10Mdj>U�´�{cÀA0q?A=@I>?N=@PA=�j�DNBTDAMdHCjKµ

;�Md?N=@g8DRgfHJj>j>=@gfDAMdHCj�`:=fDGFE=�=@jPLw\?LS�BJgf=¦S�HC?NX BTjK^�XY=QBTj>Mdj>U

{cBCj>UCw\BCUC=DGnlIK=QP |�?NMdj\gfMdI>ad=@PÂBTj\^ DN=�?NXYMOj>HJa 0HCUJn�Mdj\PAI>Md?A=Q^3`�n3I:HJPAMmDNMOHJj\BTaaxBTj>UJw\BTUJ=@PMOjKPLI>Md?N=@^Ë`lnsS�?A=@=¿FEHC?W^sHJ?K0^_=�?#axBTj\UCw\BCUC=@P

Page 196: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Ä � �������� �"� �1���#� $% ��#���! " � �%�����

Page 197: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � � ��������� �

� � � ��� ��� � ��� � � � � � � � � � ���������

>

p j6DN<>MxP#BTI>I:=�j\^>Mme��_FE=�HJw_DAadMOj\=¦<\HiFËDA<>=�HJ?AMdUCMdj\BTa:|-BTj>Mdj>M I PEUJ?NBCXkXZBC?]BTI\I>aOMd=@PDAHZPA=�j�DA=@j\gf=QPEMOj3¾_BTj\PAtl?AMOD@o-;�<>=�HJ?AMdUCMdj\BTaKDA=�elD�I\?A=QPL=@jJDNMOj\U�DN<>=�UC?WBTXYXZBT?]PAn_PGDN=�XMxPkg@BTadaO=Q^z¥�PL<�DNBJ^_<lnJB~nlM�BTj\^zFEBJP�F#?NMODLDA=@jz`ln�|-BTj\MOj>M#PAHCXY=�F#<\=�?N=�BT?NHCw\j\^ q �r�Ê�l�o�;�<\MdPkI>?N=@PA=�j�DNBTDAMdHCjºMxP�`KBCPA=@^ºHJj ��MOIKBT?WPLtlnr´ Ñ ÒJÄrdJµ�BTj\^ºS�Hlg�w\PNPL=QP�HJj�b¼´ Ñ µDA<\=�?N=�axBiDAMdHCjº`:=fDGFE=�=@jºDA<\=�PAn�j�DWBie½HTS�BCgfDAMd�C=QP��RI\BJPAPAMO�J=@P%BCj\^�PLDNBTDAMd�C=@P@�#´PdJµ�DA<\=gfHJj>j>=Qg8DAMdHCj¿`K=�DGF]=@=�j»PA=�j�DN=�j\g�=@P¦BTj\^¿j>HCXYMdj\BTaxP���BCj\^z´�ÅJµ(DA<>=k?A=@adBTDAMdHCj¼`:=fDGFE=�=@jg�BJPL=QP�BTj\^ XY=@BCj>MOj\UJP@o �@� � "�+-"���" ( 3�(5�+R9;�<>=%tiBC?NBCt~B @ PAn_PGDN=�X1HTS-|-BTj>Mdj>M�MxP�DA<\=�gf?Nw\gfMxBTac=�ad=�XY=�j�D�Mdj�BCg�g�HCw>j�DNMOj>UYS�HJ?#DA<\=MxPAPAw>=@PcXY=�j�DAMdHCj>=Q^%BT`:Hi�C=Jofl]HCjKPLMx^_=�?�DA<>=�S�HCadaOHiF#Mdj>U#S�?NHCX ��MOIKBT?WPLtln�´ Ñ ÒJÄrdCµ�F#<>=�?N=DA<\=�¥ I P-BC?A=EPL=@j�DA=�jKgf=@PRBCj\^�DN<>=#ÊEP-BC?A=]j>HCXYMdj\BTaxP[S�HC?-BCgfDAMd�C=J�iI\BCPNPLMd�C=EBTj\^kPLDNBiDNMO�J=BCP�XZBC?AtJ=@^�b' 9 � �8& !8/��'/����8/1% *��'/��'/�� + /��/ �54 9

�'& !8/��'/����8/ � �5*���9 654��,& � /��� 9 ��* * �C4 �82 � /� �54 !8& � �'&"!'/��'/����'/.4 - ��* *��E4 �82 6'4��,&�9

��� < <��5��� ��� ��&'��%�"���� ��� %���� � ��1'� ,���5����% ����& ��� ;)��"�� � ��& � 0&'# ������� � ��%�� �#� &'����������& &'� ��%��� ,�� ���)��%�,-�0,���%�&'�(������� "�#�& � <

� � ��,-"),-��"�� � # ��� ���-��� �����)< 6�� ���)����1'��,7,-�)��1'&'"��&�%�� ��� ��,-����� ���+1'1'&'")2 ��� %���� ����� %�� "���! � ��7���+" ���+")�+� &'"! (&'"�#)& &'� ������"���1'& ��� � ����� # &'" ��,&� ��"�� & ��&'�!35��& ����� " ����&'"�27��%�� ��� %)��� � 2-& ! �+" &'"� � � � "�#)& � �0<�� %�&'���+��" / � ��� �+" &'" ��%�� ���������)1'�+� 2-& ! � " &'" #�&'�$�)1 ��� � # � ����� ��& ��1 <" (,+3 ��! � ���35%�� "���! � �!����� �$� ��,&� � "�#)& ��"$1 ��"�2-����2-� &'�5��#�,&�)��� #.&'"$# "�2-1'&'��%�� ��%)� � ���+1'1'&'")2 �����+# &'� /������ #,-" ������! &',-��� ��� ��2-�.&'" 1'& ���+�������)���-< � % �)��� ����������� � &'� "�,�� �$��� 1 � ��� ���-��� ��� � � ,-� ��& � &'1 ����1 � � ������� � �)&'� "�,��5�$��� 1 �5��� ���������-� �'<#� %���� � ,-"���&'"����!��, �����!��%�� ������!���1'� "��5�$��� 1'1'&'"�2�&'" 1'& ��� � ���������-<

Ñ Ärq

Page 198: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Äro � � ����� � �!�a ���������� �n #����$%$%�� ����H�1������ �#���

' 9 � �8& !8/��'/���� & �5/�*��'/��'/1% + /�1+8/��8&�9� 4-�C- � 6 9 � �5*�� 9 � + /8-�- 4 !8&

� �C4��,&.4 -#(8&'4 �82 ��*�* �5&�� ( + �'& !'/ �'/����'/ 9

' 9 � (��8& !8/��'/����8/1% - !'/ + 4 �54 9� �5*���9 � /� �54 !8&

� �'&"!'/��'/����'/.4 - -�7�&�& + 4 �82�9

' 9 � (��8& !8/��'/���� & �5/.- � + +8/��8&�9� 4 �5- � 6 9 � - �'/ �54 !8& � �'&"!'/��'/����'/.4 - ('&'4-�82.-�7�& + ���� �'&"!'/��'/����'/.4 - -�7�&�& + 4 �82�9

��9 � �8& !8/��'/����8/1% *��'/��'/8-1+'/ + / /��/ �5/:9� �'*���9 � 28& �54 �54 !8& � �5*���9

� �'&"!'/��'/����'/ ��* * �5&,6�* * 654��,&�9

��9 � �8& !8/��'/���� & �5/ *��'/ �5/1% + /�� !'/� 4-�C- � 6 9 � �5*���9 � �'*���9

� �C4��,& ��* * �'&�� (8+ �8& !'/��'/ ���'/:9

��9 � �8& !8/��'/���� & �5/ *��'/ �5/8-1+'/ + / � �5416�9� 4 �C- � 6�9 � 28&���9 � �5*���9

� $�%8& ��* * �E4-�82�* * 6'4��,&)(8+ �'& !'/��8/����'/:9

��9 � (��8& !8/��'/����8/1% - !8/ + 4 �'/�/:9� �5*���9 � �5*���9

� �'&"!'/��'/����'/�/ -�7�&�& + &�6 9

��9 � /��8& !8/��'/����8/8-1+'/ + / � �54 % 9� 2 & ��9 � �'*���9

� �'&"!'/��'/����'/�� - ��* *��E4 �82 9

;�<>=QPL=�g�BCj6`K=�PA<>HiF#j�BJP�S�HJaOadHiF(PEMOj B%DWBT`>ad=Y´�F#<>=@?A=�DA<>=�PA=�j�DA=@j\gf=QPEj�w\X�`:=�?WPPAw �Yel=Q^ `�n G ` IKBT?N=�S�HJ?�DA<>=��J=�?N`3G PLad=�=@I I µ8b� ¹A® Í ¸ ��® �V¨ ¶ Ì ¨ ¶V­ ¨ � � ¸�j ª ¶:® § �BCgfDAMd�C= ¥%o Ñ �>¥%o Ñ ` Ê�o Ñ �>ʦo Ñ `I\BCPNPAMO�J= ¥%oed Ê�oedPGDWBiDNMO�J= ¥%o ÅT` Ê�o Å>�>ʦo ÅCB

p j�¾_BCj\PLtl?NMmDQ�TDN<>=(j>HJXkMdj\BCaKg�BCjYHlg@gfw>?]BTada\`ln�MODNPA=�aOS�´�BJP�BTjZMdj\^_=@IK=@j\^_=�j�D]PA=�j�DN=�j\g�=F#MODA<�BTj3BCPNPLw\Xk=Q^�MdXYI>adMdg�MmD G `:=5I>�J=�?N`Kµ8o|-BTj\MOj>M[BCg�g�HCw>j�DWP�S�HC?�DA<>=QPL=�PA=�j�DN=�j\g�=@P�´�BTj\^¼j>HCXYMdj\BTaxPNµ(BCP(BCamDN=�?Nj\BiDNMO�J=�?A=QBTa 0Mdh@BiDNMOHJj\P-HCS:DN<>=�PNBTXY=#w>j\^>=�?NaOnlMdj>U�PLDA?Nw\g8DNw>?A=Jo�;�<\=(BCg8DNMO�J=(MxP-j>H%XYHC?N=#`\BJPLMxgEDA<\BCj

Page 199: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� �D�p� � ���� � � ��� �� � � Ñ Ä I\BJPAPAMO�J=C��ÏGw\PGD#BCP�DA<\=¦PA=�j�DA=@j\gf=QP�BC?A=�j>H�XYHC?N=(`\BJPLMxg#DN<\BTj6DA<>=¦j>HCXYMdj\BTaxP@o[p j�DA<>MxP��MOD�MOj�DN?AH_^_w\g�=@PZBºPA=fD�HCS¦UJ?NBCXYXYBTDAMxg�BCa]S�w\j\g8DNMOHJj\P�g@BTadaO=Q^stiBC?NBCt~BJP��]F#<>MxgW<rPAI:=@g90MOS�n�?A=@adBTDAMdHCj\P�`K=�DGF]=@=�j»j>HCXYMdj\BTaxP�BCj\^�DN<>=k�C=�?N`\BCa[?NHlHTD@o¦p j¿FEHC?W^>P�HTS ��MdI\BC?NPAtln´ Ñ ÒCÄ�d1c�I�o � µ � ;�<>=�nËBC?A=»j>=�MODA<>=@?�PL=@XYBCj�DAMxg¼j>HJ?�XYHC?NI><>HJaOHJUCMxg�BCa�g�BTDA=�UJHC?NMO=QP6MdjDA<\=�XZPL=@aO�J=@P@��`>w_D�DN<>=�n¿g�HC?N?A=QPLI:HCjK^3DAH�PA=�XZBTj�DAMxg�P�BJg�gfHJ?N^>MOj>U�DAH3?Nw>aO=QP�PLI:=@g�Mm³\=Q^MdjYDA<>=#UJ?NBCXkXZBC?�BTj\^�DAH�XYHJ?AI><\HCadHCUCn%BJg�g�HC?W^_MOj\U�DNH�HTDN<>=�?�?Nw>ad=@P�PAI:=@gfMO³\=Q^�MdjYDA<\=UC?WBTXYXZBT?Qo �p j3DA<\=�=fe>BCXkI\aO=QP(Mdj��JHCad�lMOj>UYDN<>=%�J=�?N`¼gfHlHCtlMdj>U6BT`:Hi�C=J�>DA<\=�j>HJXkMdj\BCadP#?N=�I\?A=�0PA=�j�D]DGFEHkt~BC?NBCtiBCP@b[tiBT?ADNB�BTj\^�tiBT?NXZB>oR¥ tiBC?NBCt~B�MdP#B�I\BC?LDNMdg�MOI\BCj�DEMdj�DN<>=�BCgfDAMdHCj^_=@j>HTDN=@^6`lnYDN<>=��C=�?N`�o-¾l=�XZBCjJDNMdg@BTadaOnkDN<>= � ®T¹ Ì ® MxP�DN<>=¦XkH�PGD�Mdj\^_=�I:=�jK^_=�j�D#HTS[BCaOaDA<\=kIKBT?ADAMxgfMdI\BTj�DNP B ��BCj\^ � ®i¹9jZ® MdP�DA<\= � I>?AMdj\g�MOI\BCaRUCHJBCacHCS�DA<\=�tiBT?ADNB � D o�p j»DA<\==fe>BCXkI\aO=QP�MOjl�CHJaO�lMdj>U�DA<>=��J=�?N`3G PLad=�=@I Id�lDA<>=@?A=�MxP�HCj>adn6tiBT?ADNBktiBT?WBTtiB\o;�<>=Y^_=�?NMd�~BTDAMdHCjuHTS]DA<>=ZPA=�j�DA=@j\gf=kI>?NHlg�=�=Q^>P�BCP¦S�HCadadHiF(P�o�;�<\= � PLI:=@BCtC=@?���PL=�0ad=@g8DWP�´�HC?�DA<>=kUC?WBTXYXZBT?�� ¹ ¨W¨f§mÍ � ¨ ¶ ¨ ¹N® Ì ¨�Lµ��C=�?N`\P�BTj\^�j\HCw>j\P�S�?NHCX1DA<\=�ad=fe_MxgfHCjc�gfHJ?A?N=@PAI:HCj\^_Mdj>UkDAH�BTj¼BCgfDAMdHCj�BTjK^ DA<>=%IKBT?ADAMxgfMdI\BTj�DNP(MOj¼MOD@o ��BC?NBCt~Bk?N=�axBiDNMOHJj `:= 0DGFE=�=�j DN<>=%j>HJw>j\P(BCj\^ �C=�?N`�BT?N=�PL=@aO=Qg8DA=Q^3^_=�I:=�j\^>MOj>U�HCj DA<>=�PL=@XYBCj�DAMxg�?A=@adBTDAMdHCj`:=fDGFE=�=�j»DA<\=�X3��BCj\^¿DAMdXk=Z?N=fS�=@?A=@j\gf=YMxP�BCPNPLH_g�MdBTDA=@^»F#MODA<uDA<>=Y�J=�?N`�oZ;�<>MdP%MdP�BTDDA<\=�t~BC?NBCtiB�ad=��J=�a�?N=�I>?N=@PA=�j�DNBTDAMdHCju´�¾l=@=%À[MdU\o�q>o dJµ8oÀ>?NHCX DA<>=3tiBT?WBTtiB»aO=@�C=�a#?N=�I\?A=QPL=@jJDWBiDNMOHJj����lMO`\<\BTt�DAM�aO=@�C=�a#?N=�I\?A=QPL=@jJDWBiDNMOHJj�MdPUC=@j>=�?WBiDN=@^�w\PAMOj>U6|-BCj>Mdj>M I P#PAw_DA?WBCP%´�^_=@BCaOMdj>UZF#MODA<3tiBT?WBTtiBCPWµ8o�p j3DA<>MxP#?N=�I>?N=@PA=�j�DNB 0DAMdHCjc�J�lMd`><\BTt�DNM�´�HC?]g@BCPA=QµRMxP]Md^_=@j�DAMO³\=@^YS�HJ?�=QBCgW<Zj>HJw>j6BTj\^6�C=�?N`�oR;�<>=�PAw_DA?WBCP]BT?N=?Nw>aO=QP�F#<\MdgW<zBCI>I>adn½HCjzB¿?A=@I>?A=QPL=@j�DNBiDNMOHJj½DAH»I>?AH_^_wKgf=�BCj>HTDN<>=�?k?N=�I>?N=@PA=�j�DNBTDAMdHCjBiD�BCj>HTDN<>=�?Yad=��J=�aÎo |-BTj>Mdj>M I PYPAw_DA?WBCPZ^_=QBTadMOj\UuF#MODA<rXYHC?NI><>HJaOHJUCn�BCI>I>adn�HCjvDA<\=�lMO`\<\BTt�DAM�ad=��J=�a�?A=@I>?N=@PA=�j�DNBTDAMdHCj½DAHuUC=@j>=�?WBiDN=6DN<>= BJg8DNw\BTa�FEHC?W^>P�´�BTj\^zDA<lw\P�DA<\=PA=�j�DA=@j\gf=~µ8o;�<>=�XYHJPLD#MOXYI:HC?ADNBTj�D#I>?NMOjKgfMdI>aO=�HCScDA<\=�t~BC?NBCtiB%DN<>=�HJ?AnZMxP%´ ��MdI\BC?NPAtlnC� Ñ ÒJÄrdCµfb|�?AMdj\g�MOI>ad=Cb Ã��J=�?Nn tiBT?WBTtiBrX�wKPGD¿`:= � =fe_I>?N=@PNPL=Q^ �r`ln XYHJ?AI><\HCadHCUCnJ��`>w_D»j\Ht~BC?NBCtiB�XZB~n6`:=�=fe_I>?N=@PNPL=Q^6XYHC?N=¦DA<\BCj3HCj\g�=Co

�(=@?A= � =fe_I>?N=@PNP���MdP�wKPL=Q^�Mdj�B�DA=@gW<\j>Mdg@BTa�PA=�j\PA=Co{�=�D�w\P¦adHlHCt3BiD¦DA<>=Y^_=�?NMd�~BTDAMdHCj�HCS�DA<>=YPA=�j�DA=@j\gf=k¥%o Ñ ´�^>=��iBC^>BTDLDWBT<¿H_^>BCj\BTXI\BJg�BiDNMxµfo�;�<>=�^_=�?NMd�~BTDAMdHCj MdP�Mdj>MODAMxBiDN=@^ `lnZDA<>=�PAIK=QBTtJ=�?�FEBCj�DAMdj>U�DNHZ=fe_I>?N=@PNP]DA<\BTDG ;�=@�~BJ^>BiDADNBZMxP(g�H�HJtlMOj>UZ?NMxgf=Co I]¥ED�DA<>=%tiBC?NBCt~BYad=��J=�aÎ�_DA<\MdP�?A=QPLw>aODNP(MOj¼B6PLDA?Nw\gfDAw>?N=gfHJj\PAMdPLDAMdj>UzHCS��C=@?A`KBTa¦?AHlHTD G I\BCg5I�BCj\^ j\HCw>j ?AHlHTDWP G ^_=@�~BJ^>BiDADNB I�BCj\^ G H_^>BTjKB?Id�F#MODA<�G ^_=@�~BJ^>BiDADNB IKBCP�tiBT?ADNB\�KBTjK^ G H_^>BCj\B?IVBCP�tiBT?NXYB\o�À>w\?LDN<>=�?Q�:DA<>=��C=�?N`\BCac?NH�HCD<\BJPYHCj>UJHCMdj>U¿DNMOXY=º´��iBC?LDWBTXZBCBCj\BJµ�BTj\^rBJg8DAMd�C= I>?WB~nCHJUs´�adHlHJPA=�adnC�EBCg8DNMO�J=3�CHCMxgf=~µBCPNPAHlg�MdBTDA=Q^6F#MODA<3MmDQoÀ>?NHCX DA<>=kBT`:Hi�C=%PLDA?Nw\g8DNw>?N=�BiD�tiBC?NBCt~BYad=��J=�aÎ�\FE=%UC=@j>=�?WBiDN=�DA<>=�PGDN?Aw\gfDAw>?N=�BTDDA<\=���Md`><\BCt�DAM�ad=��C=@a�o�;�<\=��C=�?N`�UJ=fDWPEDA<>=%BC`\PGDN?NBJg8D#I>?N=@PA=�j�D�DA=@j\PL=�XZBT?NtC=@?�G axBC; I

� �0��% ����#�% �����)&���)��� � "�,�< �-< ��< ��� � � !���� ��" ������% ������� �-�)<� ; �)��� � �-< ��< ��� �����������5&'& ����& ����� ��� ��� ����� � �)<-; �)��� ��)< �)< � �� !���������� �-��"�� 1 ���9�)<

Page 200: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ ÄJÄ � � ����� � �!�a ���������� �n #����$%$%�� ����H�1������ �#���

ÊEnvBCj>HTDN<>=�? ?Nw>aO=J�#DA<\=¼DA=@j\PA=¿axBC;�B � =�e_I>?A=QPAPA=@P��r´�Mdj DN<>=¿DN=@gW<>j\Mdg@BTa�PA=�jKPL=~µ=�MODA<\=�?�´�Mxµ(tiBT?ADNB>�[´�MdMxµ(t~BC?AXZBYHJ?�´�MdMOM¬µ(PLDNBTDA= � o#;�<>=�BJg8DAMd�C=�I>?NB~nJHCU3´�BJg8DAMd�C=��CHCMxgf=~µPA=�ad=@g8DWP(´�M¬µ8oRp jYHTDN<>=�?�F]HJ?N^>P@�TaxBC;�B¦=fe_I>?N=@PNPL=QPRt~BC?LDWB>oE´�y(HCDA=#DN<\BiD�gW<\HCMxgf=@P#´�MOM¬µ-BCj\^´�MdMdMxµEI>?NH_^_w\g�=%PL=@jJDN=�j\g�=@P#¥�o dkBTjK^ ¥�o Å\�_?A=QPLI:=@gfDAMd�C=@aOnJo µ;�<>=#UJ=�j>=@?NBTDAMdHCj�HCS:�lMd`><\BCtJDNMdP�HTS:DA<>=#j>HJXYMOj\BCadP�MdP-BJPRS�HCadaOHiF(P@o ��BC?AXZB¦tiBT?WBTtiBg�BCw\PA=@PRBTjZBCg@gfw\PNBiDNMO�J=]=@j\^_Mdj>UZ´�^_�lMODAMdMOn�BCB¦HC?-PA=@g�HCj\^��lMO`><KBTt�DAM¬µ[DAH�`:=(BCPNPLMdUCj>=Q^�DNHG Hl^\BTj\B I �io ��BT?ADNB�t~BC?NBCtiB6j>HJ?AXZBTadadn3g@BTw\PA=@P¦BTj»MOjKPGDN?Aw>XY=@jJDWBTa-=@j\^_Mdj>Uu´�DA?NMmDNMOMdnJBJBHC?�DA<\MO?W^��lMO`\<\BTt�DAM¬µ(DAH�`:=YBCPNPLMdUCj>=Q^ DAH�DA<>=�j>HCXYMdj\BTaR`:=@BC?AMdj>UZDN<>=�tiBC?LDWB6tiBT?WBTtiB?N=�axBiDAMdHCj��iouÊEw_Dk<>=�?N=6DN<>=�ad=@BJ^_Mdj>U¿I>?NMdj\gfMdI>ad=6DA<KBiD�j\HTDA<\MOj>U»MdP�=fe_I>?N=@PNPA=@^½XYHC?N=DA<KBTj¿HJj\gf=3´�BCj\BT`\<>MO<\MmDN=Qµ¦gfHJXk=QP�Mdj�DAH I>axB~nCo�¾lMdj\gf=ktiBT?ADNB�<\BCP¦BTad?N=@BC^>n `:=�=@j»=�e^0I>?N=@PNPL=Q^�`ln�adBJ;��VMmD%PA<>HCw>ax^¼j\HTD�`K=Y=fe_I>?N=@PNPA=@^¼BCUJBTMdj�o%;�<lw\P@�VDA<>=kMdj\PGDN?Aw\Xk=@j�DNBTag�BJPL=YMxP�j>HTD%BJPAPAMOUJj>=@^¼DAH G ^_=��iBJ^>BiDADNB?IdoYp j\PLDA=@BJ^���j>HJXYMOj\BTDAMd�C=Zg�BJPL=3´�I\?NBTDA<\BCXYBJBHC?%³\?NPLD%�lMO`\<\BTt�DAM¬µ�MxP�BJPAPAMOUJj>=@^¿DAH�G ^_=@�iBC^>BTDLDNB IO�[F#<>=�jºHJj>adn¿DN<>=6j>HJXkMdj\BCa�PGDN=�Xj>HCDAMdHCj��_UJ=�j\^_=@?(BTj\^ jlw>X�`K=@?#?A=@XYBCMOj�DAHY`:=�=fe_I>?N=@PNPL=Q^��ioÀ�MOjKBTadaOnJ�KDN<>=Y?A=@I>?N=@PA=�j�DNBTDAMdHCj¼BiD¦DA<\=��lMd`><\BTt�DNM�ad=��J=�aRMxP�DWBTtJ=�j¿BCj\^�DN<>=�FEHC?W^S�HC?NXZP#BT?N=�UC=�j\=�?WBiDA=Q^�o;�<>=¦^_=�?NMO�iBTDAMdHCj6I>?NH_gf=QPAPA=@P�HTScj>HJXYMOj\BCadPEBTjK^6PL=@j�DA=�jKgf=@PEBT?N=�g�HCXYI>ad=fDN=�adnkIKBT?F0BTadad=�aÎo%;�<>=�n¼BC?A=k^_=�?NMO�J=@^3S�?NHCX Mx^_=@jJDNMdg@BTaRtiBT?WBTtiBZ?N=�axBiDNMOHJj\P�`:=fDGFE=�=@j¼DN<>=�j\HCw>j\PBTjK^6DN<>=��C=@?A`�o;�<>=%�J=�?N`\BTacj>HCw>j¼g@BTj¼BCUJBTMdj�`:=%MOj¼DA<>?N=�=%I\?NB~nJHCUY=fe_I>?N=@PNPLMdj>UZtiBT?ADNB\�\tiBT?NXZBHC?�DA<>=(I\?AH_gf=QPAP@o[;�<\MdP�UCMd�C=@P�w\PRDA<\?A=@=(tlMOj\^\P-HTS�j>HJXkMdj\BCadP�PA<>HiF#jYMdj6Ê�o Ñ ��ʦo d�BCj\^ʦo Å\�V?A=QPLI:=@gfDAMd�C=�adnCo�p j¿Ê¦o Ñ �:DA<>=k^_=�?NMO�iBTDAMdHCj¼MxP�adMdtC=�¥�o Ñ =fe>gf=@I_D¦DA<\BTD�DA<\=�tiBT?NXZBHTSR�C=@?A`KBTaVj>HCw\j�MxP#=fe_I>?N=@PNPA=@^6`ln�DA<>=�UJ=�j>MODAMd�C=�g�BJPL= >�� o;�<lw\P@�JDN<>=�BCgfDAMd�C=@P@�lI\BCPNPAMO�J=@P@��BCj\^�PLDNBTDAMd�C=@PEHJj6DA<\=¦HJj>=¦<\BTj\^�BTj\^ PA=�j�DA=@j\gf=QPBTjK^ºj>HCXYMdj\BTaxP%HJj½DA<>= HTDN<>=�?�<\BTjK^��-g�BTjz`K= BTj\BCaOnlh�=Q^½=�ad=�U�BTj�DAadn»MdjzB�IKBT?WBTadaO=@aXZBTj>j\=�?#`lnZDA<\=�t~BC?NBCtiB%DN<>=�HJ?AnJo �9& � 5�2k7R+-5�$��BT?WBTtiBYPAnlPLDA=@X MxP�BCadPAHZMOXYI:HC?ADNBCjJD(Mdj3S�HC?NX�w\adBTDAMdj>U6gfHJjJDN?AHJa�HTSRj>HJj10�³Kj>MmDN=%�C=@?A`KPMdj3g�HCXYI>ad=fe�PA=�j�DN=�j\g�=@P@o l]HJj\PAMd^_=@?�DA<>=�S�HJaOadHiF#Mdj>UkPA=�j�DN=�j\g�=@P@�lS�HC?(=�e_BCXYI>aO=Jb� 9 � 2 6'/�/�� /�� / /,2'/���+'/ �8&"!��'/����8/1% *��8/��5/�� + /��/��'4 9

!54�7�7 /,28& � ' ��� 9 �'& !��'/���� � #5*���9�654��1& � ' ��� 9 ��* * �C-%'/"!54 �82 � /,6 654 !8&��

� � /"!'4 �82./,6 6'4 !8&��./�����%'&�!'4�7 7 /,2 & � �'& !��'/����'/ ��* *��E-)654��,&:9

� 9 � 2 6'/�/�� /�� /�/,2'/�� +8/ �8& !��8/����8& �'/ *��'/��'/1% + /��1+'/��8&:9' ��� 9 4 �C- � 6�9 �5*���9

� ; �)��� ��)< ��< >�� 1 ��% ����� � ��"�& �+� /)%��-��! � �+�-�������$� ���-� /�% ����% <� ; �)��� ���)< )< � �����$� ��"�& # ! & ��&'& ���-�)< ; �)��� ���)< )< � = ����������& ����� ��" � , � ����& ��&'& ���-�)< ; �)��� ���)< )< � > �)� �-����& ����#�& ���-������%���1'&'"�2�� ��������& � �-��"�� !-���+��"���� �-������� ��������%���� �-�)<��� ; �)��� ���)< )< >�� ����������& �����$� ,-"�,-% � ��& ��& <

Page 201: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � �3���#� �!��� ��� Ñ ÄJÒ� � �8& !��'/����'/ %5/"!54-�82./,6 654 !8&��./�����%'&�!54,7 7 /,28&���654��,&)0'/8-��* *��5&�� (8+ �'& !��'/ ���'/:9

�(=@?A=J�\DN<>=YBTUC=@j�D�HTS G BT?N?AMd�C=CI>?N=�XZBTMdj\P(w\j\gW<\BTj\UC=@^¼MOjnl�o Ñ BCj\^ l�oedZ`:=@g�BCw\PA=%DA<\=Hi�C=@?LDNaOn½PAIK=QgfMO³\=@^ºtiBC?LDWB�HTS G gfHlHJt I[?A=@XZBTMdj\P�DN<>= PNBTXY=Jo»|-BTj\MOj>MEUCMd�C=QP�DN<>=�?Nw>ad=F#<>MxgW<�PAB~n_P]DA<\BTD@b��BC?LDWBZHTS]DA<>=kUC=@?Aw\j\^¿PAw �Yez´�t�DA�iB Mdju¾_BCj\PLtl?NMmD8µ(MxP�DA<>=ZPNBTXY=�BJP�DA<>=YtiBT?ADNB�HTSDA<>=�XZBTMdj �C=�?N` > > oy(HCDA=�DA<\BTD�DN<>MdP�MxP�w>j\aOMdtC= Ã�j>UJaOMxPL<c��F#<\=�?N=�gfHJj�DA?NHCa�MxP%S�HJ?AX�w>axBiDA=Q^ºMdjºDA=@?AXZP�HTSPAw>`_ÏG=@gfD@�>HJ`_ÏG=@gfD#=fDNgCo|-BTj\MOj>M�<\BCPZUJMO�J=�jrUC?N=@BTD6MOXYI:HC?ADNBCj\gf=�DNHzgfHJj�DA?NHCa#Mdj j>HCj30�³\j\MmDN=¼�C=@?A`\P@o�¥jlw>X�`:=�?�HCS]PLw>DA?WBCP¦UCMd�C=�?Aw>ad=@P�S�HJ?�g�HCj�DA?NHCa�HTSEPLw\gW<u�C=@?A`KP�o%À\HC?¦=fe>BTXYI>ad=C�c¾lw>DA?WBÅ>o Å>o Ñ qCÄ(S�HJ?-�C=@?A`\BCa_?AHlHCDNPRF#MODA<YDAw\X�w>j�´�Mdj_³\j\MmDNMO�J=(HTSVI>w>?NIKH�PL=J�CPAw\gW<ZBCP@�iDAH�UJH�µ > @ o

����������� ������������

;�<>MxP�BTI\IK=@j\^_MOe�MxP�`\BJPL=Q^�HJj ��MOI\BC?NPAtln%´ Ñ ÒCÄrdJµ8o ��?NMdUCMdj\BTaTPAHCw>?Wgf=QPVBT?N=�|-BTj>Mdj>M I P¥�PA<�DNBJ^_<lnJB~nlMTF#?NMmDADA=�j%PAHCXY=@F#<>=�?N=�`:=fDGFE=�=�j d �r�r� DAH�dpo �p� nJ=@BC?NP�BCUCHK�Q|-BTDNBTjTÏLBTadM I P�¼BC<\BT`><KBCPA<�n�B3´�PAHCXY= d ÑR�p� nC=QBT?WP#BTUCHlµ8�\ÊE<\BC?LDN?NBC<\BT?NM I P�É�BCt�n�BTI\BJ^_MdnJB ´�?NHCw>UJ<>aOnÑ q �p� nC=@BC?NP BTUJH�µf� ��BTw\j\^_`><\BTDLDWB?I P�É�BCMOn�BTtiBT?WBTjKB�0�`\<�wKPL<\BCj\BCPNBT?WB ´�BT`:HCw_D¼Årq �nC=QBT?WP6BTUJH�µf��y�BTUJ=@PA< Ê]<KBiDLD�I P {cBCUC<lw>XZBTjTÏGw\PL<KBË´�BT`:HCw>D dpq � nC=QBT?WP6BTUJH�µ8o ¥�aOaDA<\=@PA=�F]=@?A=¦F#?AMODLDN=�j3Mdj�¾>BTj\PAtl?AMOD@o;�<>=¼BC`KHi�J= BC?A=3I\BC?LD6HCS�DN<>=¼|-BTj>Mdj>MxBTjsDA?WBC^_MODAMdHCjËBCj\^rBT?N=3B~�iBCMOaxBT`>ad=3F#MmDN<gfHJXYXk=@j�DNBT?Nn ´�MdjËÃ�j>UJaOMxPA<s=�e_g�=�I_D6BJPYj>HTDN=@^\µfb,�CMdUCn�BCPAw ´ Ñ Ò TÒJµ�´�Mdj ��MOjK^_MxµkHJj¥�PA<�DNBJ^_<lnJB~nlMPc �CH�PL<\M(´ Ñ ÒroCÄ�µ�BCj\^ ��MO=@aO<>HJ?Ajr´ Ñ Ò � µ�HCj �¼BT<KBT`><\BJPL<ln�B3c[¾l<KBCPLDA?NMBTjK^s;[?AMdI\BTDA<>M%´Îµ�´�MOj ¾_BCj\PAt�?NMODWµ�HCjvÉ�BTMdnJBTtiBC?NBCj\B�0¦`><lw\PL<KBTj\BJPABC?NB c]¥(`\<�n�BTj>tiBC?BTjK^�{cMOXZB~nC=Z´ Ñ Òpo�qCµ]BTj\^ ��=�axBT?WBiÏLB�HCj É�BTtlnJBCI\BC^_MdnJB�´�ÊE<\BC?LDN?NBC<\BT?NMδεLµ c�=�DNgCo¾l<\BJPGDN?AM[´ Ñ Ò iÅ�µ]´�MOj ��MOjK^_Mxµ�BTj\^ lEBC?N^_HJj\BY´ Ñ ÒCÄCÄ�µ�BT?N=#UCHlH_^�XZBTDA=�?NMxBTaxPRHCjYDA<\=|-BTj\MOj>MxBTj�DN?NBJ^_MODAMdHCj�ocÀ\HC?�?A=Qgf=@jJD�^_=�`\BTDA=QP�HCj�|-BTj>Mdj>MxBTj¦DA?WBC^_MODAMdHCj�PL=@=�;�=QPL<\I\BTj\^>=´ Ñ ÒCÄ�qCµ8� ��MdI\BT?WPAt�n¼´ Ñ ÒJÄrdCµf��¼BiDNMOaxBTa�´ Ñ ÒJÄrdCµf� lEBT?W^_HCj\B ´ Ñ Ò oJµ8�_BCXkHJj>UYHTDN<>=�?WP�opqD3MdP MdXkI:HC?ADNBCj�D�DNHsXY=�j�DNMOHJj DA<KBiD3DA<>=@?A=uMxP Bs�lMO=@F DA<KBiD�;cHJaOtiBTI\I>MOn�BTX I PUC?WBTXYXZBT?YS�HJ?�;�BTXYMda�I>?N=@^>BTDA=QP6|-BTj>Mdj>MÎo ¾lMOXYMdadBC?AadnC�EDN<>=�?N=¼FE=�?N=¿B½jlw>X�`:=�?�HTSI>?N= 0 |-BTj>Mdj>MxBTj UC?WBTXYXZBT?WP]S�HC?�¾_BCj\PAt�?NMOD@o]¥�aOa[DA<\=@PA=%BT?N=%PLMdXYMOaxBT?(Mdj¼PAI>MO?NMOD@o�;�<>=�?N=MxP¦B�j>=@=@^�DNH PLDAwK^_n¿;[HCadt~BCI>I>MdnJBCX I P�UC?WBTXYXZBT?(S�HJ?�;[BCXkMda�S�?AHJX gfHJXkI\w_DNBTDAMdHCj\BCa�lMO=@F#IKHJMOj�DQo ��w>?�g�HCjiÏG=Qg8DNw>?A=EMxPRDA<\BTD-MmD�F#MdaOa_`:=#Mdj\PGDN?AwKg8DAMd�C=#BCj\^�F#Mdada_H�V=�?�PAMOXYMdadBC?`>w_D(Mdj�DA=@?A=QPGDNMOj>UYMdj\PAMOUJ<JDWP�o;�<>=@?A=¦MdP�B��iBJPGD(BTXYHJw>j�D�HCS�adMODA=�?WBiDNw>?N=�HJj�DN<>=�|-BTj>Mdj>MxBTj3BTj\^�?N=�axBiDA=Q^6DN?NBJ^_M 0DAMdHCjKP�o�¾l=@= lEBT?W^_HCj\B ´ Ñ Ò oJµ�S�HC?(BYPAw>?A�J=�nZHCS�?N=@PA=@BC?NgW<�o;�<>=@?A=3BT?N=�XZBCj�ns^_MdPNgfwKPAPAMOHJj\Pk?A=@adBTDA=Q^ºDAHuDN<>=�|-BTj>Mdj>MxBTj�DN?NBJ^_MODAMdHCj��]MOjvDA<\=adMmDN=�?WBiDAw\?A=%HCS�y�B~�lnJB 0qy�nJB~nJB ´�p jK^_MdBCj¼PLn_PLDA=@X1HCS-aOHJUCMxg%BTj\^3Mdj_S�=@?A=@j\gf=~µ#BTj\^�DA<\BTDHTS���MdXZBTXZPAB3´�p j\^_MxBTj3PLn_PLDA=�XÆHTSR^_MdPNgfHJw>?WPL=�BTjKBTadnlPAMxPNµfo

� � ; �)��� ��)< ��< � � ����� ��"�������������& ����� ,-% �����)� !-�����-��1'�-<� �-; �)��� ��)< )< � � = ����� �-��"�������������& �-� ��� ��������" <

Page 202: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Ò � � � ����� � �!�a ���������� �n #����$%$%�� ����H�1������ �#���

Page 203: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� � � ��������� �

� � � � � � � ��� ��� � � � � �

� � ��� � � � ���

Ñ Ò Ñ

Page 204: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Ò�d � � ���� � � � � � $%�� � � � ���f��� � ��� � �� �1���� #�#�

"E�A����� # ¤����K�@�>�@���:� ���Q�l�r���r����� �=���c���

Page 205: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ ÒJÅ

"]�A�R��� ( ¤ �f�V�Q�J¡i���>��¡i�E�[¡i� �@�l�V�Q�_�@���K�r���r� �[���J�K¢�� �[�@��¡

� �K�: :�J¡8�Q���:� �[¡i���\¡i�>¢.� ����� � �l�l�r����� �Y���\�Q�_�@���K�Ë�>��� �,� � � �=�@�@�>���[�>¡~��_¡i�¼�5 >�\�����?�������Ρ~�l�¼���(� ���_¡ �K����¡i�:¢ �����¼�?�[�����K¡ � %

Page 206: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Ò � � � ���� � � � � � $%�� � � � ���f��� � ��� � �� �1���� #�#�

Page 207: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

� ��� ��� � � � � � ���

� Ñ ��¥�`><\B~n�BTj>tiBT?Q���Yo É�od�TBTjK^�É�o |Ro@{�MdXZB~nC=J��� ® � Í ®'k>® ±iª¬Í ®�¸ � � ·\®i¹ Ì ¹A·>®i¹ ª¬�l¾_BTj30PAtl?AMOD(BTj\^3|�?NBCt�?NMOD#¾l=@?AMd=@P@�_É-HCaÎo d_� ��j>Md�C=�?WPAMmDGn6HCSR|RHlHJj\B>� Ñ Òrorq>o� d ��¥�<lwiÏLB>�K�%o �Yod�(;�<>HCXZBJP6{�o��¼BTUJj\BTj�DNM��#BTjK^ �JBCXk=QP�ʦo���?NadMOj�� ��¨fÌ�� ¸i¹ ��§ ¸ � �� � · ¨ ¸i¹ Í � ��§ ��¸i¹ ª¬Ì ·^j � ®T¶ ± � kpk §mª ­N® Ì�ª ¸T¶ �8�#|�?N=�j�DAMxgf=�0 ��BTada��]Ã�j>UJaO=�0FEHlH_^ l]adM �P@�\y(=@F �J=�?WPL=@nC� Ñ ÒJÒCÅ\o� Å ��Ê�BC?LDNHCj��>Áko\Ã]^_FEBC?N^�� �(HC`:=�?ADl�o>ÊE=@?AF#MxgWtV�lBCj\^ Ã�?NMdg�¾Vo?�#MxPLDNBC^�� � ¸�jk �_«Ì ® ÌΪ ¸i¶V® § � ¸ j�k §O¨N©Cª¬ÌÎÍ ®T¶ ± � ® Ì � ¹A® § � ®i¶ � � ® � ¨�� �¼pG;Â|�?A=QPAP@��lEBCX�`>?NMx^_UC=J�

�¿¥%� Ñ ÒCÄ _o� � ��ÊE=@?AF#MxgWtV� �#HJ`K=@?LD-l�od��¾Vo |Ro�¥(`\j>=�nJ�EBCj\^�l�o];c=@j>j>=�nJ�¦´�=@^>P@o µ8��|�?NMOj\g�MOI\aO=�0Ê�BJPL=Q^�|-BT?WPLMdj>U\b l]HCXYI>w_DWBiDAMdHCj BCj\^ |]PLn_gW<>HJaOMdj>UCw\MdPLDAMxg�P@� ��aOwlFE=�?¿¥�g�B 0^>=�XYMdgC�\ÊEHJPLDAHJj�� Ñ ÒJÒ Ñ o� q ��ÊE<\BCjlw>XZBiDAMÎ�VÊ�od� � ¶ � krk:¹A¸Q®C­W· Ì ¸��¿®J­N· ª ¶ ¨ � ¹A®i¶ �8§ ® ÌΪ ¸i¶�®�jZ¸i¶ � �8¶ ±iª ®i¶

� ®i¶ � � ® � ¨ �8�E;[=@gW<co �#=�I:HC?ADY; ��l�¾�0 ÄCÒ 0qÒ � � ;�=�I_DQo-HTS l�¾_Ã(�-pApG; ��BTj\I>w>?Q�;�=@gCo Ñ ÒJÄCÒ\o

� o ��ÊE<\BC?NBTDAMÎ�c¥(t_PA<\BT?%BCj\^ �(BiÏG=@=��»¾>BTj>U�BTaÎ��¥ ��BT?WBTtiB�ÊEBJPL=Q^»¥�I>I>?NHJBJgW<¿DNH|-BC?NPAMdj>U�HCS-p j\^_MxBTj¼{cBCj>UCwKBTUC=QP��-p j ��� � � � ����� � ¹N¸@­���¸ � �8¶ Ì � � ¸i¶ � ��¸T¶� ¸ j�k �_Ì ® Ì�ª ¸T¶:® § �-ª ¶ � �_ª �WÌΪ ­ ��� � ¸ § ����� ����¨�§ �8ª ¶ � ª¬��¥�PAPAH_gfMxBiDAMdHCj½S�HJ? l]HJX 0I\w_DNBTDAMdHCj\BCa�{�MdUCw>MxPGDNMdg@P��Ky ���K¥(w>UJw\PGD Ñ ÒCÒ � ��I>I�o drq?0�dTÒ>o

� %��ÊE<\BC?NBTDAMÎ�T¥(t_PA<\BT?Q�8�(BiÏG=@=���¾_BCj>UJBCa��TBCj\^%É�MOj>=@=fD l]<\BCMmDWBTjlnJB\�ly�BiDNw>?NBCa_{cBTj30UJw\BTUJ=¿|�?NH_gf=QPAPAMOj\U\��l]HCXYI>ad=fe_MODGnË;�<>=�HJ?AnËBTjK^ {�HJUCMxgT� p j ¸ � ¶ ± ® Ì�ª ¸T¶ �¸ � � ¸ �WÌ�� ®i¹ ¨ �\¨ ­W·l¶V¸ § ¸ � Í ®T¶ ± � · ¨ ¸i¹ ¨fÌΪ ­W® § � ¸�jk �_Ì ¨ ¹ � ­ ª�¨ ¶:­ ¨"! � � �[¨ ­ «Ì � ¹ ¨ � ¸ Ì ¨��ª ¶ � ¸�jk �_Ì ¨ ¹ � ­ ª�¨ ¶:­ ¨$#&%�'C��¾lI>?NMOj>UJ=�?�É-=�?NadBCU�ÊE=�?NaOMdj�� Ñ ÒJÒ � B\�I\I�o �KÑ2� 0 � d � o� Ä ��ÊE<\BC?NBTDAMÎ��¥(t_PA<\BT?Q��É�Mdj>=�=�D!l]<\BTMODNBCj�n�B>��BTjK^)�(BTÏG=�=@�¿¾_BTj>U�BTaÎ��¥ l]HCXYI>w10DWBiDNMOHJj\BTa�À>?WBTXY=�FEHC?Nt6S�HJ?�p j\^_MxBTj»{cBTj\UCw\BCUC=@P@�#;c=QgW<>j>Mxg�BCa��#=@IKHJ?LD�; ��l�¾�0Ò � 0 Ñ2�r� � ;�=@I_D@o-HCS l�¾_Ã��[pApG; ��BTj\I>w>?Q� �Cw>adn Ñ ÒJÒ � `�ov´Il]HCw>?WPA=�j>HCDA=@P�S�HJ?p j�DN=�j\PAMO�J= l]HCw>?WPL=�HJj y�{c|sS�HC?({cMOj>UJw>MxPGDWP��>É-HJa�o Ñ µ8o

Ñ Òrq

Page 208: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

Ñ Òro ��� ��� ��� #������ �

� Ò ��ÊE<\BC?NBTDAMÎ�>¥(t_PA<\BT?Q�_É�Mdj>=�=�D�l]<\BTMODNBCjlnJB>�_BCj\^ �(BiÏG=@=���¾_BCj>UJBCa��-{cHlg@BTa muHC?W^Á¦?NHCw\I>MOj\U�BTjK^%pqDNP �#=@aO=@�~BCj\gf=]DAH¦p j\^_MxBTj�{cBTj\UCw\BCUC=@P@��p j�É�M ÏLB~n%|Ro~Ê]<KBiDAtiBC?BCj\^ ��Md?NBCj��ºo �#=�UJ=C�K=@^_MODAHJ?NP@� ¹A¸i¶ Ì�ª�¨ ¹ �%ª ¶ � ¶V¸ ��§O¨W± � ¨ � ® ��¨N± � ¸�jk �_ÌΫª ¶ � �\I\BTUJ=@P�d ��3dTÒpo\oJy�BT?NHJPNB�|�w>`>adMdPA<>Mdj>U �(HCwKPL=J�>y(=�F ;�=�ad<>M�� Ñ ÒCÒ Ñ o� Ñ2� ��ÊE<\BC?NBTDAMÎ�J¥�tlPA<\BC?@�JÉ�Mdj>=�=�D l]<\BTMODNBCjlnJB>�JBTj\^ �(BTÏG=�=@�k¾_BCj>UJBCa��V¥�l]HJXkI\w_DNB 0DNMOHJj\BTaVÁ¦?NBCXYXYBC?�S�HJ?�p j\^_MxBTj�{cBTj\UCw\BCUC=@P-|�?AH_g�=@PNPLMdj>U\� �f¶ ±iª ®T¶ �Rª ¶ � �_ª �8Ì�ª ­ �

� ¸ � ¹8¶:® §¯��qrd>´ Ñ � � µ8b Ò Ñ � Ñ2� Å>� �¼BC?@o � ;�=@gCo Ñ ÒCÒ Ñ B\o� ÑCÑ ��ÊE<\BC?NBTDAMÎ�(¥(t_PA<\BT?Q�#É�Mdj>=�=�D/l]<\BCMmDWBTjlnJB\�#BTj\^ ��BiÏG=�=@�r¾>BTj>U�BTaÎ� �¼BJgW<>Mdj>=;[?WBTj\PAadBTDAMdHCjkBTj\^�DA<>=({[BTj>UJw\BTUJ=EÊ�BC?A?NMO=@?@�_p jYÉËÉ ¾Y¾_BT?NXZB>�CyvÉ�MdPAFEBCj\BC^10<KBTX3�KÊ ��=�UCjKBTj\BC?NB~n�BTj\B\��BCj\^�Ê {�;�=�=@t_PL<\BTDAw>adw��>=Q^_MODAHC?WP@� � ¹ Ì�ª � ­ ª ® § �f¶ «Ì ¨�§¬§¯ª � ¨ ¶:­ ¨ ®i¶ ±��-© k ¨ ¹ Ì �:Í��WÌ ¨ j �\¨ ­W·l¶V¸ § ¸ � ª�¨ �%ª ¶ Ì · ¨ �f¶ ±Tª ®i¶u­W¸T¶ Ì ¨A©JÌÎ�J�JHCa 0w\Xk= d>�_I\BTUJ=@P�qCÄ��^oro>ol;[BTDNB�� �¼gQÁ¦?NB~F ��MOada��:y(=@F ;�=�ad<>M�� Ñ ÒJÒ Ñ `co� Ñ d ��ÊE<\BC?NBTDAMÎ�K¥�tlPA<\BC?@�V¾Vo ¥�oKy�B~FEBTDA<>=J�\É�Mdj>=@=fD l]<KBTMODNBTjln�B>�\BCj\^#�(BiÏG=@=���¾_BTj30U�BTaÎ��¥�y�=�F p j_S�=�?N=�j\g�=�|�?NHlg�=@^_w\?A=�S�HC?l]HCjKgf=�I>DAw\BCacÁ¦?NBCI><\P@�[p j"#>Ì · � ¶ ª¬«

hi¨ ¹ �Wª¬ÌÎÍ ¸ � ��¨���� ¹ � ¶ ���-ª ­ � � ¹ ÌΪ � ­ ª ® § �8¶ Ìq¨�§¬§¯ª � ¨ ¶V­ ¨ �KÍ jk>¸ �Wª � j ��À>?N=@^>=�?F0Mxg8DNMOHJj��\y�o ʦo�lEBCj\BC^>B\oO� Ñ Ò��1d Ñ ¾l=@I_D@o Ñ ÒJÒ Ñ ^�o� Ñ Å ��ÊE<\BC?NBTDAMÎ�[¥�tlPA<\BC?@��É�Mdj>=�=�D l]<\BCMmDWBTjlnJB\�[BTjK^ ��BiÏG=�=@�u¾_BCj>UJBCa�� l]HJXkI\w_DNB 0DNMOHJj\BTa:{�Mdj>UCw\MdPLDAMxg�P�BCj\^kpqDNP �#=�axBiDNMOHJjYDAH%{�Mdj>UJw>MdPLDAMxg�P@� �8¶ Ìq¨ ¹8¶:® Ì�ª ¸T¶:® § ¸ � ¹ «¶V® § ¸ ��� ��h���������� ����� � ��� ������� ��� ������ d ��!#"�$po��%" "�&'� � (*)'+,"�- -/.�0'1�#"2& �4365'0 780�9 :���;<>= 5'0 7���?:@)*+2+29BAC5'0 :D9�0�)>EF0'��0�)HGJI0�KL+2+�MJN�0 )*OF0 PQ�FRTSVUW��U43X0 )'G

Y�0 )*:@)*:@0 )ZS'780 [\+2]6^ 78<>=�!4;_)a`RVYb?:@+2]dce^ :@)F9��f�g) �*h��ji�k����l6i�� � � �m���� �on �Bp ' ��� �� � � 'F�e�qsr � ��i��e��lCtui� � � v'i8wXi�� �xi�y_w%h��jr2 �6 i���r� �k��� �i{z_n �k����� �V��� � h'� � r �k�*|+�c�9�1�^ }BA~N��_�/�{�L����0�)*c*('7��%"�.��e"�����0�7���5�"�-F-F.����c'c�1#"2��&>.�1���;P@= ^0�M�0�:@P�0��*P@+�0 =��dI_A~N/�g-F.��8"�&F$*��|+�c�9�1�^�}HA~N��_���{�L����0�)'c*(*7�1 ��1

� "����4365'0 780�9 :���;_<�={5H0�7����W���47 :�={5')'0_365'0�78OF0�M�0'��0 )'G�I_0�KL+2+2M�N�0 )*OF0 PQ�>Id+2}�+278+2)'�2+0 )'G���P#P@:#cH={:�=�:@)�0�)��g)'G�:�0�)�RV0�)*OF('0�OF+�=%�g)/9 +�7{}�0F��+�98^s|J0�980 �'0 = +�=�� ��i�y_w%h��jr2�o����r2�e��rW���%� � ��z�i�ky,����������i�h�k�e��l&' � �H�*�HN>+�c�9�1T"�- -F�*�>c*c�1H� $����F.*1

� "����4365'0 780�9 :��H;<>= 5'0 7s0�)HG�I_0�KL+�+2M�N�0�)*O/0�P��dY�0�7�={:@)*O,S*78+2+���^F78GX�s7�G�+27sRT0�)*�OF('0�OF+�=s('= :#)*O�9 5'+\Y�0 )*:@)*:@0 )XS*7�0�[\+�]C^F7 <%���g)�n � � � � �6 i�� � iLz�ns�'�Hh'��l� r�r2�Q��� � iLzxn � �2i��������Q��i��z�i���xi�yweh��g������i��e��l �B��� � h�� �k������k1�;=8={^��2:@0�9 :@^ )�}�^F7AC^F[\c*(�980�9 :@^ )'0 P�R�:@)*O (':@={9 :��2=4�'`_��1@��"�-F- �F0*�>c*c�"�$F����" "F" 1

� "����4365'0 780�9 :��*;_<�= 5'0�7���?:@)*+2+29JAC5'0�:#980 )>EF0*�*0 )'G�I_0�KL+�+2M�N�0 )*OF0 PQ� �xi�h� ��r�y,����gr2k����loi��fn �xi�y_w%h��j���Q��i��e��l � ��y�y,�� �����r��\i�� �d���'���H����� o8��y,r ��i� � ��g)HG�:@0 )fN>^���:@+�9LE�}�^ 76�T+���5*)*:��20�PH��G�('��0�98:#^F)��F��:@)*:�=L987 EW^�}� (*[,0�)¡Id+�={^F(*78�2+|s+2MF+2P@^ c*[\+�)F9��'`_+�]¢|s+2P@5*:��%�J�k98^ �e+274"�-F- � ��1

� "����4365'0 780�9 :���;_<�={5H0�7���?s:#)'+2+�9�AC5'0 :D9�0�)>EF0'��0 )'G�I_0�KL+2+2M�N�0 )*OF0 PQ�>;_)>('=80�7�0�<�0d^F7RV0�)*OF('0�OF+�;����+�=8= ^ 7�!~;£N>5*^F7{9�g)/987 ^�G�('��9 :@^ )��J�g) �68r�2r2�'�gr8�u��� �%r2y����%��

Page 209: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�������������� ���� � "�->�

i��Xnsh��ji�y\���Q��� �* ��� ��l@������i��'�o�~5*:@78(*M�0�)'0 )F985*c*(*7�0�[u�o�J�k9 ^F�H+�7�"�-F- �F��1*�g)/9�1=8��5*^>^ P ^�}'|s780�M>:�G�:@0 )�R�:@)*O (*:�={9 :��2=�1*��;_P�= ^s0�M�0�:@P@0 �*P@+x0 =��dI_A~N/�g- ���g. $F�C|+�c�9�1^ }xA~N*�_���{�L� ��0�)'c*(*7k�k1

� "�-��4365'0 780�9 :���;_<�= 5'0�7��o?:@)*+2+29WAC5'0�:#980 )>EF0*��0 )'GZI_0�KL+�+2MXN�0 )*OF0 PQ�\;_)>('=80�7�0�<�00F=~0���+�0 = (*78:#)*OW|+�M>:@�2+s}�^F7�985*+�R�:@)*O (':@={9�� �g) �~ r�2r2�'�gr��¡���x��v*rs������l#i � h'ri�� �h��Qh� r �B��� � h�� �k�Q��� ����� � �%������� '�' � ' # �Wr8� � ! ��� � 1_AC+2)/98780 Pd�g)'=L98:D98(�9 +}�^��g)'G*:@0 ) RT0 )*O (H0�O +�=2�x��E>= ^ 78+ �C|+���+2[��H+�7u"�- -F� Go1 �Q;_P�={^�0�M�0�:@P@0 �*P@+�0F=�dI_A~N/�g- ���g.*"�$�|+�c�9�1*^ }xA~N*�_���{�L� ��0�)'c*(*7�1 ��1

� .�$��4365'0 780�9 :��T;_<�= 5'0�7���?s:#)*+�+�9WAC5'0 :D9�0�)>EF0'��0�)'GZI_0�KL+2+2MZN�0�)*O/0�P��¡;_)a0�c'c*7 ^ �c'7 :�0�98+J={9 7�0�98+2O EW}�^F76[,0F��5*:#)'+_9 7�0�)H={P�0�98:#^F)¡:#)�:@)'G�:�0*� �g)�N%1 N%1*;_O/0�78]60 PH0 )'GN�(*�*5'0F={5�Y�0 )*:Q�H+�G�:#9 ^F78=�� � ��z�i�ky\���Q��i�� �Hr��8v��ei�l#i ��� nCw w%l ����������i�� ����� �T���'�� h'� � r�� �%�2k� we��� � w*r�r���v>�'`+2]b|+�P#5*:��T"�- - &F0*1>3~Y�3 Y�(*�*P@:@��0�98:#^F)'=21

� .�"2�4365'0 780�9 :�� ;_<�= 5'0�7�� ?s:#)'+2+�96AC5H0�:#980�)>E/0*� 0 )'G\I_0�KL+�+2MWN*0�)*O/0�P��H�V7 +�+_;G�KL^F:#)��:@)*O�UJ780 [\[\0 7J0 )'GZY�0�)*:@)*:�0�)�UJ7�0�[\[,0�7����V+���5*)*:��20 P�Id+2ce^ 7 94�dI_A~N/�g-�& �.*"�-'�>|s+2c*9�1'^ }�A~N���*�{�L� ��0�)'c*(*7��>�X0�7���5�"�- -�&F��1

� . .��4365'0 7 O/0�M�0*� ��1 �\1@� Id+2}�+278+2)'�2+ 0 )'G �xP@P#:@c'= :@= :#) 0 `R �g)/9 +27 }�0 �2+ 98^|J0�9�0��'0F={+�=2�*��1 �V+���5�1>985*+�= :�=2�'|s+2c*9�1*^ }xA~N�����{�L� ��0�)*c'(*7��o"�- -/.�1

� .����4365'0 7{98780 5'0�78:�� N�0 G�5H0�)'0 N>(*[�('G*G�+�={5'0 ��� �{� <�0�)'G*0/�k� :#) 3C5H0�7 9 7�0�5'0 7 :���e� � � �8w'� ��� � ��]d:D985 985*+���^F[W[\+�)F987 Ea^ }J +2P�0�7�0�K{0*�xYB^>^F)'0*1~���V780 )'= P@0�9 :@^ ):@)��x)*OFP#:�= 5��>Ef�\1'N>('�*780 [,0�)>EF0��gE +�7��*YB^>^ )H0F�

� .�& �4365'0�9{9��>I0�KL+�= 5�� �d���H���'����� �%v*r�i� � z�i� �6� � l � � v��*3s1 �V+���5�1F9 5*+�={:�=��/|s+2c�9�1>^�}A~N*�_���{�L� ��0�)'c*(*7��o"�- -F�*1

� . ���436P@^���<e�~ 0 )'={���P#78:@��5T�60 )'G  0�)H=¡ 0 (*O +�)*+�G�+�7��~;_) � �¡��:@+2)'�2EF�{�s78:#+�)F98+�GRVSVU Y�0�7�={+�7��/�g)�Id+2E>P@+�0�)'GuId^F5*7 +�7��L"�-F� �/�k�>c*c�1@"2&/-���"����'1

� .����43678+�= )'0�)T��� ^/0�)��*��+�Go1 �k� �%v*r � r��H�j��l/qrgwe8r�2r2�'�g������i���i{z � ��yWy,�������8��l/qsr��l@������i�� �k�e�a1 �k1 �41'Y�7 +�= =��'A60�[��'7 :�G�O +F����;���"�- �/.�1

� .F���436('G*5*:#7�0�K{0'�o`0�M>:#)T�TN>(*�*7�0�9�0f��:#9 7�0*�� s0�78:@= 5���0 7 )*:���<%�e0 )'GXI0�KL+2+�MXN�0�)*�O/0�P��xY�0�7�={:@)*OXUJ+�)*+27�0�P@:���+�GaY�5*780F={+�=L987 ('��9 (*78+�UJ7�0�[\[,0�7�]d:D985 |sE>)'0�[\:������c'0�)'= :@^ )�� �6 i�� � iLz � �H� � tui� � � v'i8w i�� �_�� �k��� � �Hr��8v��ei�l#i � ��r ��1BAC+2)/9 +�7}�^F7_��0 ��5':#)*+��V780 )'= P@0�9 :@^ )��HA6� ���'Yx:#9{9�={�'(*7 OH�*;_(*OH1o"�-F� -*�>c*cT1*&/� ���/&/�/��1

� .�����A60 78G*^ )'0'�6UJ+2^F7 OF+ � �d���H���'� �n �Hh�"!�r � i{z\qsr�2r���8�8v��~��^ (�98^ )��~ 0 O (*+2�Y�0 7 :�=��e"�-/���*1

� .�-���A60 78G*^ )'0'��UJ+�^ 78O + � �d���'���'� ��� ��t�i� � ���e� � � � ��8� ��������i��#� � �Hi�l � ! ��F� � �� i�h��e�f���e� � �'�� i���h'�2�Q��i�� � �*��^ 9 :@P@0 PT3~0�)'0 78= :@G'0 =��/|s+2P@5*:���"�-F� �*1

� � $���AC5':#+�78��5*:�0*�eUJ+2)*)'0 7 ^H�'0�)HGuN*0�P@P#E�����AC^F)*+2P@PD�LUJ:@)*+�9�� � r����'��� � ���e� � ��yW�y,��k�H���L�¢Y�7 +�= =��'A60�[��*7 :�G�OF+ ����0 =8=�1#�o"�- -*"F1

Page 210: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

"�-F� �������������� ���� �

� �*"2��AC5'^ [,={<>EF��`_^F0 [u1 �Tr��2�Qh� r �Wi�� � i�!�r�k�Hy\r2�'�s���e� �d���%����� � �VS'^ 78:@=���|s^ 7 �G*7 +���5F9��o"�-F�*" 1

� �F.���AC5'^ [,={<>EF�_`_^F0 [u16���ei �6l@r8� � rai{z �V��� � h'� � r� � � � �����Qh� r�� �6k� � ��� ���e����2r�1'Y�780 +2OF+27~Yx(*�*P@:�={5*+�78=���`_+�]��x^F7 <%�o"�-F� �'1

� � ����AC^FcH+�P@0 )'Go��As1#� �'1 |s(*7�0�)'G��FN%1F�47�0�(>]6+27���0�)'G\3J1 ��0 +2OF0F0�7�Go� �%v*r �6h� i��Q8������ � h�� �k�Q��� ��w'r���� �6�8���Q��i��'�%N/9 ('G*:#+�=d:#)���0F��5*:@)*+��T7�0�)'= P�0�9 :@^ )�0�)'Gu`s0�9 ('780 PRV0�)*OF('0�OF+JY�7 ^��2+�=8={:@)*O'�/?�^ P�1�"F�H� �,�2+J}�^ 7s� �¡��:�0�P�Y�(*�*P@:@��0�9 :@^ )H=C^ }xAC^F[W�[\:�= = :@^ )�^�} 9 5*+���(*7 ^FcH+�0�)�AC^ [\[�(*)':D98:#+�=2�'RT( ��+2[��*(*78O'�%"�-F-*" 1

� ��& ��AC^�M>:@)*O�98^ )�����:���5'0�+�P ;�1@��Y�0�7�={:@)*O~|:�= �2^ )/9 :@)>(*^ (H=VAC^ )'={9 :#9 ('+2)/98=T:#)�|s+2ce+2)��G*+2)'�2E�UJ780 [W[,0 7����Q�T+���5*)*:��20 P�AC^F7 78+�= ce^ )'G�+�)'��+��k� �xi�y_w%h��j���Q��i��e��l �����'�� h�� �k�Q��� �k��"��'� &��Q|+���1�"�- - $/�k�>c�1 .�� &'1

� �F���4|J0 = 5��>�\1 As1@�o��+�Go1 ��� � �e������� �%r2y,���'����� ����;OF0�[,0 <�0 P@0�Y�(*�*P@:@��0�98:#^F)'=2�/|+�P#5':Q�"�- - &'1

� � ���4|J0�98+ �'As1 �'1 � �H�Q8i���h'������i��u�gi������j� � ���2r�� � �k�gr�y �k�>;sG*G�:�={^F)��j��+�={P@+2EF�>I_+�0 G��:@)*OH�'��;��T"�- �>�>1

� �/���4|s+�= 5*c'0 )'G�+F����0 G�5H0�M4��1#� �~l�l � w �2r �_���e��� � �'�g� �2�Q���$��!�r2kl#�8wFwe��� � �� h�k8r��H�� � ��h'r ����� �d���H���'����� � � �'�g� �2�Q��� �%v*r�i� � �o365'0 )'G*0�78<�0�7s�s78:#+�)/980�PVId+�= +�0 78��5�g)H=L98:D98(�9 +F�HYB^>^ )'0�&'"F"�$F$�&��g)'G*:@0'��"�-F�F��1

� � ���4|s+2^H�e`s0�7�={:@)*OF5�1 � ��w*v �%v*r�i� � 1�Y�7 +�)F98:@�2+��g 0 P#P��'�x)'O P@+2]6^/^�G�ACP@: � =2�o`+2]�F+27�= +2E �o"�-/��&'1

� � -��4|s^ 787��s36^ )*)':#+F�; N>(*78M +2E ^ }\AC^ (*7�= +�=¡:@)bAC^F[\c*(�980�9 :@^ )'0 PJRT:#)'O (*:�=L98:@��=2�;s= = ^���1�^ }xAC^F[Wc'(�980�9 :@^ )'0 P�R�:@)*O (*:�={9 :��2=��*`_+2] �F+27�={+�E �%"�-F-�&'1

� &F$��4|s('0 7{98+ �>�g)*+�=�1��_�g3~0�7C�~5'+2^ 78E%!V�j9�=~Id^ P@+:@)�U43 �~5*+�^ 78E 1/�g) �����Qh�8��l �T���'�� h'� � r �68i���r � �k��� � �6R�+���9 (*78+�`^�98+�=W:#) ;_78:D98:��e��:�0�P~�g)/9 +2P@P@:#OF+2)'�2+ ��N>c*78:@)*O +�7?�+�7 P�0�OH�*36+278P#:@)��o"�-F- $'1

� &'"2�4�C0�78P#+�E � �F0�EF�T;_)�� �,�2:#+�)/9WAC^ )/9 +��/9 �jS'7 +�+¡Y�0�7�={:@)*Ou;_P@O ^F7 :#9 5*[u� ��i�y�yWh���H����������i�� ��i{zsn � ��� �'�*�T"�-/��$*�/c*c�1 &/�*"��j&/� �*1

� &/.��4��M +�)'=,0�)'G RV0�787 E���0 7{9 9 (*)*+�)��dN>(*78M +2E ^ ) AC^ [\c*(�9�0�9 :@^ )H0�P_R�:@)*OF(*:@={9 :��2=AC^F(*7�={+�=2� n � �2i��������Q��i���iLz �xi�y_w%h��j���Q��i��e��l �B��� � h�� �k������k� `+2] �F+27�= +2E �>"�- � �'1

� &F���4S :@)'G�P@+27��/`:@��5'^ P�0 =x?�1e��+�Go1 �k�*n � �2i��������Q� !�r ��r2����i� � � 6qrgwe8r�2r2�'�g������i������e����2r�i{z_���%i �~l#r�� � r ��� ��i�y_w%h��jr2k�';s�20 G*+2[\:@�4Y�7 +�= =���`_+2]¢�x^ 78<%�o"�->��-*1

� & & �4S :@P#P@[\^ 78+ �'AC5'0 7 P@+�=��'1@�*�~5*+�A60 = +_}�^F7_A60F={+F�>�g)��_1�3~0 ��5�0�)'G�I�1 �41* s0�78[,=+�G�:#9 ^ 7�=�� �V�H� !�r2 �2��l �4iLz ����� � h�� �k�Q��� �%v*r�i� � �� ^ P#9CId:@)*+25'0 7{9�0 )'G\� :@)'=L98^ )��`+2]¢�x^ 78<%�o"�- �F�*�>c*c�1@"��g� �'1

Page 211: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�������������� ���� � "�-F-

� &/����U40���G*0 7���UW1@���_1��4P@+2:@)*+F��UW1 �\1�Yx(*P@P#('[���0 )'G4�k1 ;�1�N�0�OH� � r2�er2 ��l ����r�� �xv� ���2r�e�Qkh'�2��h� r � ��yWy,��k�'3~0 = :@P�3CP�0 ��<>]6+2P@PQ�%"�- �F�*1

� &F����UJ('c�980'�>;s={5':@= 5���N%1/��+2P@5*^�98780'�F0�)HG,�a1>N*0���+2)'0Wn �d�� �2r�Bz�i� �& � ���%�,�� ��y�y,���z�i�������e�����*3s1 �V+���5�1F9 5*+�={:�=��*|+�c�9�1>^�}�A~N���� �L����0�)'c*(*7��H"�- � �'1

� &>����UJ('c�980'�>N�0 )'G�+�+2c,�\1 No1#�F?:@)*+2+29~AC5'0�:#980 )>EF0*�F 0�78:�={5\��0�78)*:���<e�F0�)'G\I_0�KL+2+2MN*0�)*O/0�P��Bns��ns8�8v����jr��2�Qh� rsz�i� �d�� ��l�l#r2l~���e����� �k��k� � h��gr�� �d�� ����� � iLz � �'�������� �V��� � h'� � r �k���V+���5*)*:��20 P6I_+2ce^ 7 9����dI_A~N/�g� -��j�/.���|+�c�9�1B^ }4A~N�� �{�L���0 )*c*(*7��o"�-F� -'1

� &F���4 s0�+�O +2[,0 )���Rx1@�W�g)F987 ^�G�(H�k9 :@^ )b98^ UJ^�MF+278)*[\+2)/9�0�)HG 3C:@)'G�:@)*O �~5*+2^F7 EF�3~0F={:@P�36P@0F��</]6+2P@P��e"�- -'" 1

� &F-��4 s0�787 :�=��/RV0�787 E\I�� �= +27 �L�s78:@+2)/9 +�G,|s0�980��H0 = +��s(*+�7 E\]d:#9 5uId�J3_�J� `0�9 (��7�0�P�RV0�)*OF('0�OF+��s('+278EfN>E�=L98+2[u� � �H� � � iLz � ���'� � � ��v>���%r �H��h'����r �k�o"�-/�F�>1

� ��$��4 s0�('=8= +27��*Id^ P�0�)'G�� ��i�y_w%h��j���Q��i��Zi{z �T��� � h'� � r��eN>c*78:#)*OF+27~?�+278P�0�O'��36+278P@:#)��"�- �F-*1

� ��"2�4 +2)'G*7 :��o�'UW1 UW1@�'��0 7 P�N�0F��+�78G�^ 9 :���|�1'N�0 OF0 P#^�]d:����F�/0 )'G �H1'N>P@^���(*[u�'|s+2MF+2P#�^Fc*:@)*O�0�`0�9 (*7�0�P�RT0 )*O (H0�O +��g)F98+27 }�0 �2+�98^�AC^F[Wc'P#+���|J0�9�0*�Vn � � �� ��� � �i����W���g� � ���2r � � �k�gr�y � � � ' �T"�-/���*�>c*c�1@"�$/����"2&��>1

� � .��4 ^ c%��78^�}�9�� �H1 �160 )'G�I�1 �a1_��0 7 cT��� ;����� �;_P@O ^F7 :#9 5'[ }�^ 7u��0���:@[�(*[�X0�98��5':#)*OZ:@) 36:@c'0�7 9 :#9 +�UJ780 c*5'=�� � � � � n � �xi�yw � 'a�L"�-/���F�k��c'c�1 .F. ���. �*"F1

� �����4 ^ c%��78^�}�9�� �H1 �1B0 )'G � + � 78+2E�|�1��_P@P@[\0 )�� � �'�� i � �gi�nsh��ji�y\���j� �%v*r�i� � ��V��� � h'� � r � �6���%� �xi�yweh��g������i��H�H;sG*G�:�={^F)����Z+�= P@+2E �o"�-/��-*1

� ��& �4 ^ 78^�]d:D9 � ����P#P@:@=��V0 )'G�N�0�7 980�KJN�0�5')*:Q� �xi�yweh��gr��nsl � i�k����v>y �k�BAC^ [\c*(*9 +27N*��:@+2)'�2+�Yx78+�=8=2�%"�->���'1

� � ���J�gEF+27��C�\1xN>(*�'780 [\0 )>EF0*� �Cv'��k�� ��v'��k��i�� � r���� �k���)*:@M +27�= :D9LEa^ }JYB^>^ )'0'�c'c�1H.��F���g��&/�*1

� ������F:@O EF0F={(T�W367�0�5*[,G*0�9{9�1�n �{v��j�F��v � � � � � �Cv'��� v � � � �6 ����v*��y\� !�8����� ����v>8r8r!�i�lDh�y\r �k�CI_0 [WP�0�P~��0�ce^>^ 7\�T78('={9W3~0�5H0�P@OF0 G*5��_�QN>^F)*+2cH0�9��C 0�78EF0 )'0*�B�g)��G*:@0/�k��"�-/��-'1o���g)� _:@)'G�:��

� �F����F^F= 5*:���;_7�0�M>:#)HG��\1#�C�T78+2+u;G�KL^F:#)':#)*OaUJ7�0�[\[,0�7�!f _^�] [�('��5 AC^F)/9 +��>9 �N�+2)'= :D98:#M>:#9LEf:�=_Id+��F(':#78+�G�9 ^,c'7 ^�M>:�G�+47 +�0 = ^ )'0 �*P#+�N/987 ('��9 (*7�0�P�|s+�=8��78:@c�9 :@^ )�1�g)�|�1'|s^�]~9LE �'R�1H��0 7{9 9 (*)*+�)��'0 )'Gu;�1��e]d:���<>E���+�G*=�1 ����������h� ��l �V��� � h'� � r�_�� �k��� � �HA60�[��*7 :�G�OF+ �_)*:@M +�78= :#9LEWY�7 +�= =���A60 [��*78:�G�O +F� ��\�e"�-F�F�*� c*cu.�$ ���.F��$'1

Page 212: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�$F$ �������������� ���� �

� ������F^F= 5*:��d;_7�0�M/:@)'G �\1@�~;) �g)/9 78^>G*('�k98:#^F) 9 ^��V7 +�+X;G�KL^F:#)':#)*O UJ780 [W[,0 78=�1�g) ;�1���0�)H0 ={9 +27 �gI_0�[\+27���+�G�1 ��� � ����v*r2y\���Q��� �ui{z �V��� � h'� � r2��� ^F5*)�36+2)��K{0 [\:#)'=��';[\={9 +�78G'0�[u�o"�-F�/�>1

� ��-���F^F= 5*:��F;780�M>:@)'G,�\1#�/Yx78^���+�=8= :#)*O�AC78^F=8={+�G\0�)'G¡N>+�7 :�0�PH|+�cH+�)'G�+2)H��:@+�=�� � i{z�V��� � h'� � rW���%� �xi � �H���Q� !�r �6 i���r� �2r�d���o"F�o"�- -F$*�>c*c�1@"��L.F��1

� � $���F^F= 5*:��4No1 |�1���+�G�:#9 ^ 7k�k1 �_���g��� � ��l ��� � � � � � �� ���%� � ��v'� � v*��� v � ���u��= +2M +�780 PMF^ P@(*[\+�=��k� �)*:#M%1*^ }BYB^>^F)'0*��Yx(')*+ �o"�- � �'1

� �*"2�4��0 c*P�0�)��fI�1 �a1@��0 )'G �F^F0�) 367 +�={)H0�)��fRT+���:��20�P�S*(*)'��9 :@^ )'0 P�UJ7�0�[\[,0�7�!; S'^ 78[,0�P_N>E�=L98+2[ }�^F7¡UJ780 [W[,0�9 :��20�PdId+�c*78+�= +2)/980�9 :@^ )��C�g) �%v*r � r��H�j��lqsrjw% r ��r2�'�g������i�� iLz � ��yWy,�������8��lVqr2l#���Q��i�� �k� �F^F0 )�367 +�={)H0�) ��+�Go1 �k� ���L�Y�7 +�= =��'A60�[��*7 :�G�OF+ �o"�-F�F.*�Fc*cT1�"������L.��*"F1

� �F.��4��0F={5'< +�9��V��:���5'0 +2Px3J1#�BY�0�7�= :#)*Ou0�}�78+2+��j]6^ 7�G>��^F78G*+27P�0�)'O ('0 O + !���0�78P@c*:#78:���~ i�� � i{z ' #*��v�ns�'�'h'��l � r8r2����� � iLzsn � �B�o"�- �F�*�>c*c�1'�F$��g� �'1

� � ���4��0�9 �F� �H1 �H1#�e0�)'G �H1 ;�1HS'^>G*^ 7��H�~5*+�N>9 78('�k98(*7 +�^�}xN>+2[,0�)/98:@���~5'+2^ 78E ���T���'�� h'� � r � � �V"�-F� �*�>c*cT1#"���$��L.�"�$*1

� ��& �4��0�EF�'��0 7{98:#)��HS*(*)'��9 :@^ )'0 P UJ7�0�[\[,0�7�� �6 i�� ��� ��v�ns�H�'h'��l � r�r2�Q��� � iLz���v*r�sr2 � r2l#r � �B��� � h�� �k������ �oi��2��r�� � ��"�-/��-'�>c*c�1@"2&/.��8"����'1

� �F���4�4:@+2P@5*^F7 )��oS61@�x��+�G�1 ��� �ev'r � � � � �� ���e��� � ��v*� � v*��� v � ��iLz �d���j��� � ��lD��� �9{98^�%+2P@P#+�7�?�+278P@0 Os�J={)H0��*78('��<%� "�-/��$'�F�QId+2c*78:@)F9V^�}�+�G�:#9 :@^ ),"�� �F$F�k1 c�1�����[ "F1#"F1#"�����g)�N�0�)'= <>7 :#9���1

� � ���4�4:@)*OH�*��0�78OF0 7 +29��*n ��h��gi�k����lTi�� � �F�8v����er �* ��� ��l@������i��'���Z^ 78<>:#)'OWY�0 cH+�7� �*���{N*NHAd���'UJ+2)*+�M�0'��"�-F�/��1

� �/���4�4:@c'0 78= <>E ��YB1@� �%i�y\r �%v*r�i� r���������l �68i � l#r�y �¢��� �_���'���H��� � � ��y�y,��k�365'0 )'G*0 7 <�0�7�s78:#+�)/980�PoId+�={+�0�7���5f�g)'={9 :#9 (*9 + �eYB^>^ )'0�&'"F"�$ $ &��g)'G�:�0*�T"�- �/.�1

� � ���4�4)>(�985��'|s^ )'0 P@G��_1@� �h��e�F��y,r��H�j��lHnsl � i�k����v�y �k�e;G*G�:�= ^ )��j��+�={P@+2EF�o"�->���*1� � -��4�4('5*)��> �1 � 1#� � �~5*+s _(*)*O/0�78:@0 )W��+�9 5'^>G,}�^ 7�985*+;=8= :#OF)*[\+2)/9CYx78^ �'P#+�[ �'�

����!���l%qr ��r��� �8v �Ti � � ������� ���~h'��k�jr2kl � � '¡�L"�-F�F� �k��c'c�1 �F���g-/��1� ��$��4�X0�9 :@P�0�P��H3J1 �\1@�eN�^ [\+WAC^ [\[\+2)/9�=_^�}�Y�0�9�0�)�K{0 P#:T(*)'G�+�7sYB1@" 1 .�1 ��&'� �~ i�� � i{z

��v*r � �H�jr2k�e���Q��i��e��l �%r2y����%��¡i�� �d���H���'���BAC+�)/9 78+W^ }6;sG�M�0�)'�2+�GaN/9 (HG�EX:@)N*0�)'= <>7 :#9�� �)*:#MF+27�={:#9LE¡^ } YB^>^ )'0'�%"�- �/.��>c*c�1T" "�-��8"�.��'1

� �>"2�4��^ 5'0 )'0�)����\1 YB1#� UJ7�0�[\[,0�98:@��0�P/Id+2P�0�98:#^F)'=T:@)��X0�P�0�EF0�P�0�[u���g) �%v*r � r��H�j��lqsrjw% r ��r2�'�g������i�� iLz � ��yWy,�������8��lVqr2l#���Q��i�� �k� �F^F0 )�367 +�={)H0�) ��+�Go1 �k� ���L�Y�7 +�= =��'A60�[��*7 :�G�OF+ �o"�-F�F.*�Fc*cT1H��$ &��L��� -'1

� ��.��4`s0�7�0 = :#[\5'0 )���I�1@� � i�� r2l ��� � �T��� � h'� � r �sr8v'��!���i�h�k��N>c*78:#)'O +27 �j?�+278P@0 O'�36+�7 P@:#)T�o"�- �'" 1

Page 213: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�������������� ���� � .�$'"

� �����4`s0�7�0�EF0 )'0*��?�1 `�1@�>ns�Hh ���� � � �n �Wr�!�����r_�gi ��!�r�8�8i�y\r_��v'r �V��� � h'� � r ���k�k��r2k��Yx5�1 |�1�9 5'+�= :@=��/|s+2c*9�1/^�}VA~N��_�F�{�L� ��0�)'c*(*7�� �/0�)>('0�78E¡"�- -�&H1 N>(*�*[\:#9{�98+�Go1

� ��& �4`:#78+2)>�e+278O'�FN�+278O :@+ � � � ��v>���%r �� ��� �kl#���Q��i�� �%v'r8i� r2�Q������lo���%� � r2��v'i��Fi�l#i � �������l � � �kh'r ���HA60 [��*78:�G�O + �_)':#MF+27�={:#9LE¡Yx78+�=8=2�'A60 [��*78:@G*O + � �s�\�o"�-F�/�>1

� �����4Y�0 c'0 G*:#[\:#9 78^ (���AC5*7 :�={9 ^F=V �1@��0�)'G��\1�N/9 +�:#OFP#:#9 �F� ��i�y � ���e���ji�k����l �Vwe����yW�����������i��H�'Yx78+2)/98:@�2+��g 0�P@P��>��)*O P@+2]6^>^�G�ACP@: � =2�H`_+2] �F+27�={+�E �o"�-F�F.*1

� �����4Y�0�9 )'0 :#<%�e3s1 `�1@�oR�+��>:��20 PVS'(*)'�k98:#^F)'0�P�UJ7�0�[\[,0�7�� �xi�h� �2r ��i��jr ��z�i� � � �z�i� �B��� � h�� �k� � ���ei�l � ' �%i�y,r �xi�y_w%h��j���Q��i��e��l � i�� r2l �iLz �V��� � h'� � r2�*"�- - $'1�Q;_M�0�:@P�0��*P@+_0 =��V+���5*)':@��0�P*Id+�cH^F7{9��dI_A~N/�g- $��8"�$*" ��|s+2c�9�1 ^�}TA~N��Z�{�L� ��0�)*�c'(*7�1 �

� � ���4YB+�7 7�0�KL(T� 36+2)HG*0�c*(HG�:C?�1 No1#�Cnsl � i�k����v>yW���fn �Qw'r���� ��iLz �����Qh� ��l �V��� � h'� � r�_�� �k��� � h �k��� � �d���H���'����� � ��y\r���i� � �C�a1 �V+���5�1 9 5'+�= :@=��x|+�c�9�1�^ }JA~N��_�� �L�¢��0 )*c*(*7��*|s+���1T"�- -/.�1

� �����4YB^FP#P�0�7�Go�VAs1@� �Vr�����h� r ��i��gr�¡i�� ��r�� ������k� !�r�� �xv>8���2r �H��kh'����h� r � ��yW�y,�� �k�JAC+�)/9 +27�}�^ 7f9 5*+�N/9 (HG�E ^�}�RT0 )*O (H0�O +�0 )'G �g)�}�^F7 [,0�98:#^F) ��A~N�RT�{�k��)*:@M +27�= :D9LE¡^ }�AC5*:��20 O ^,Yx78+�=8=��e"�- �/��1

� ��-��4YB^FP#P�0�7�Go�FAs1@�/0 )'GW�gM�0�)¡N�0�OH�/ns� � ��z�i�ky\���Q��i��'� �s���2r���nCw w% i�� ��v¡�gi � � �'�g������e� �or�y,���H�Q��� �k�o?�^ P�1B" �VA~N�RT�R�+��k9 ('7 +\`_^ 9 +�=W"��*��N/980 )�}�^ 7�G �)*:@M +27�= :D9LEF�"�- �>�>1

� � $��4I0 G>}�^F78Go�d;)'G�78+2]�1 �* ��� ��z�i�ky,������i��e��l � ��y�y,��k�sA60 [��*78:�G�O + �_)':#MF+27 �= :#9LEfYx78+�=8=2� �s�\�o"�-F� �*1

� �*"2�4I0�[,0�<>78:@= 5*)'0 [\0F��5'0�78E>(*P@(��H�\1 ?�1@�oY�0�)*:@)*:�0�)XRT:#)*OF(*:�=L98:@��=s0 )'GZAC^F[Wc'(�980��98:#^F)'0�P_RT:#)'O (*:�=L98:@��=2� �%��y !������~N>+�7 :@+�=\)'^'1C./�>�C;s�20FG�+2[�E�^�}�N�0�)'= <>7 :#9¡Id+��= +�0 78��5T�>��+2P@< ^�98+ �*��0 7 )'0�980 <�0'�%"�- -F�*�>c*c�1e� .��g�F.*1

� �F.��4I0�[\+�= 5��HYB1 ?�1e0�)'G�I0�KL+2+�M�N�0 )*OF0 PQ�'�L= = (*+�=_:#)��g[\c*P@+2[\+2)/9�0�9 :@^ )�^ }xRTSVUW��~ i�� � i{z ��������i��e��l �or�yW���e��Zi�� � � �6�C?s:@= 5'0 </5H0�c'0�9 )'0 [��d�g)HG�:@0'�|s+���1"�- �F-*1s�QY�0�ce+27�0�M�0�:@P@0 �*P@+X0 =u�V+���5*)*:��20 PJI_+2ce^ 7 9u�dI_A~N/�g� -��j�>�>�_|s+2c�9�1d^�}A~N*� � �L�¢��0 )*c*(*7�1 �

� � ���4I0�M/:�=80�)*<�0�7�� YB1 ?�1@� �6�>v'���e��r2y\r2�'� � �ji ��v'r ����� � h�� ��� � � tui� � � r2�e��v>���1 �V+���5�1*9 5*+�={:�=2�*|s+2c*9�1'^ }�A~N���*�{�L� ��0�)'c*(*7��e"�- -/.�1

� ��& �4I_+2:@)*O ^FP@Go���1 �a1@��0�)'G�I�1 `�1�Id+2:@)*OF^ P�Go� �d���2��nsl � i�k��v���y �k�HN*��^�9 9���S*^F7 +�[,0�)0 )'G�AC^'1@�'UJP#+�)>M/:@+2]����gP@P@:#)*^F:@=���"�- � �'1

� �F���4I_+2E>P#+F� �_]6+ �o0�)'GZAC5*7 :�={9 :�0�)�Id^F5*7 +�7���+�G*=�1 ��� �����Qh� ��l��V��� � h'� � r �_�� �k��� ����e� ����� � h�� ������� �%v*r�i�k��r�k�T|�1oId+2:�G�+2PBYx('�*P#:�= 5*:#)'OuAC^ [\c'0 )>E �%|^F78G�78+���5/9��"�- �F�*1

Page 214: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�$/. �������������� ���� �

� � ���4I_^ O +�78=�� �/0�[\+�=��s0 )'G �\1~?: K{0�E/�gN�5'0�)*<F+27��; S*^ 78[,0�P@:���0�98:#^F) ^�}�Y�0 7{98:@0 P|s+�=8��78:@c�9 :@^ )�^�}��T78+2+�=2�*|s7�0�}�9�� � (*)'+W"�- -/.�1

� �/���4I_^ O +�78=����F0 [\+�=���0 )'G��\1�?: K{0�E/�gN>5H0�)*<F+27���I_+�0 = ^ )':#)*O]d:D985�|s+�=8��78:#c�98:#^F)'=V^�}�V78+2+�=��%n � � � ' �6 i�� � iLz4ns�'�Hh'��l � r�r������ � i{zJn � �2i�� � iLz �xi�y_w%h��j���Q��i��e��l����� � h�� �k�Q��� �k�';A6Rx��"�- -/.�1

� � ���4I_^ O +�78=�� �F0 [\+�=��x0�)'G �\1V?s: K{0�E/�LN>5'0�)'< +27����s��980 :#)':#)*OZ�T78+2+�=�}�78^ [ �~5*+�:#7|s+�=8��78:@c�9 :@^ )'=�!x;_)�;c*c*P@:@��0�9 :@^ )�98^¡�T78+2+2�j;sG�KL^ :@)*:@)*O¡UJ780 [W[,0 78=�� �xi�yweh���g������i��%��l � �'�gr2l�l � � r2�e��r � i�h�k�%��l �V"�- -F�f��N>(*�*[\:#9{9 +�G'�k1

� � -���N*0�:@)F9 �j|s: �2:@+27��VY�0�987 :���<%�%��0�)*)':@��<X�V^ (H= =80�:@)/9�� AC5*78:�=L98^ c*5*+,|s+2P�0�(*)H0�E �T0 )'GY�0F= ��0�P@+�N>+��*:#P@P@^�9��C; `s0�9 ('780 P~RV0�)*OF('0�OF+fYx78^���+�= = :#)'OXN>E�=L98+2[ 3~0 = +�Ga^F)985*+sUJ^�MF+278)*[\+2)/9�0�)'G,36:@)'G�:@)*O��~5*+�^ 78E � :@)fN�0 :#)/9{�g|s:���:#+�7�0�)'G¡N �2c'0 < ^�]d:�����{"�-F- $F����c*c�1�"�$ ���8"�&F$*1

� - $���N*0�:@)F9 �j|s: �2:@+27���Y�0�987 :���<%��0�)HG N%1�N �2cH0�< ^�]d:����F�f��+�G*=�1 ��� �Vi � ��� ���%� �Vi � ���� ��y�y,�� �xz�i� �T��� � h'� � r �~ i���r � ����� � �e�xP@P#:�=d _^F7 ]6^>^�Go�'AC5*:@�2+�={9 +�7��o"�- - $'1

� -*"2��N*0�)*O/0�P�� I_0�KL+�+2M%� ��0F��5*:@)*+d�T7�0�)'= P�0�9 :@^ )T� ' � � !���}�^ 78[W+�7 P@E �o����r2�e��r �'i�� � � �k��/0�)T1o"�- �F-*1

� -F.���N*0�)*O/0�P���I_0�KL+�+2M%� �6 i � 8��yWy���� � �d�� � ��� � y �_��� � � � �~���X��UJ7�0�]  _:@P#P�� `+2]�x^F7 <%�o"�- -*"F1

� - ����N*0�)*O/0�P��FI_0�KL+2+2MW0�)'G\?s:#)'+2+�9dAC5'0�:#980 )/E/0*� ;),�g)/9 +278[\+�G�:�0�98+RT0 )*O (H0�O +6}�^F7�X0 ��5*:@)*+_�V780 )'={P�0�98:#^F)�!T;)¡;_c*c*78^F0F��5��H0 = +�G�^ )¡N�0�)H={<>78:D9��s={:@)*O�AC^ )H��+2c*�98('0�PUJ7�0�c'5 `_^ 980�9 :@^ )�� �xi�y_w%h��jr2 �o����r2�e��r � � ��z�i�ky,��������k��� ^F(*7 )H0�P6^�}AC^F[\c*(�9 +�7N>^���:@+�9LE�^�}V�g)HG�:@0'��"����o" ��c*cT1'-��L.�"F�e"�- �>�>1

� -�& ��N*0�)*O/0�P��/I_0�KL+2+�Me�/?:@)*+�+�9dAC5H0�:#980�)>E/0�0�)'Gf 0�78:�={5¡��0 7 )*:���<%�F;)f;_c*c'7 ^/0 ��598^���0 ��5*:@)*+~�T7�0�)H={P�0�98:#^F)�:#)W�g)'G�:�0�)\RT0 )*O (H0�O +�=2� �68i�� � iLz � �e� i�� ��� t�i� � �� v'i8w i�� � � ���gr2y �,���e� �H� � �e��l �6 i��8r � �k��� � �T�g)'G�:�0�)��g)'={9 :#9 (*9 +,^�}dN���:@+2)H��+ �3~0 )*OF0 P#^F7 +F� �/0�)�1o"�- �F�*1

� -F����N*��5'0��e+�=��'�JM +�=2� � ����v*r2y\���Q������l����e� �xi�yweh��g������i��%��lTn ��w'r8�2� ��iLz �Tr �F���8��l �����r�� � 8��yWy\�� ���HYx5�1 |�1*9 5*+�={:�=2� �)*:@Me1'^�}�YB+2)*)'= E>P#M�0 )*:@0'�%"�- -F$*1

� - ����N*��5'0�)*<%�oId^FO +274YB1@��0�)'G�I�1 YB1o;�H+�P@= ^ )�� �o��k� w%� � � � i���l � � �6l#��� �¡���e� � �'��Fr� �k�g���%����� � �HRV0�]d7 +�)'��+4��0 7 P@�'0 (*[ ;=8={^��2:@0�9 +�=��* _:@P@P@=8G*0�P@+ �*`��'�T"�-/�F�>1

� -/����N�+2)*OF(*c�980'� Yx78^ �H0�P�� �~� �Vr � ������lH���%��� � �H�j�F������� �~ i���r �k��� � iLz �s��� � l#� �T���'�� h'� � r ��� �xi�yweh��gr2k�_Yx5�1 |�1x9 5*+�={:�=2�~�g)'G*:@0 ) ={980�9 :�=L98:@��0�P_�g)H=L98:D98(�9 +F�sA60�P#��2(�9{9�0*�HN�+2c�9�1�"�-F- ����= (*�*[\:D9 9 +�G'�k1

� - ����N�5'0 ={9 78:Q�AC5'0 7 (HG�+2M%� � � � � ��8���e� �Tv*���e��8i��F� � � � �Hi�l � � !��ji � � 1�|+�P#5':Q!��^�9 :@P�0�P�3~0�)'0 78= :�G*0 =8=21%"�-/���'1e���g)� _:@)'G�:��

Page 215: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

�������������� ���� � .�$F�

� - -���N�5'0 ={9 78:Q�'UJ^Fc'0�P��*0�)HG�I0�[\c*7�0 =80 Gf�V78:#c'0�9 5*:����H��� � � � �� ���e��6v>h � v'��� �2�� � �o�� ��l#� �eh � i���v����'� � � � � v � � ��!�� � i�w*r2�g���XAC5'0�('</5H0�[��'5'0N*0�)'= <>7 :#9N>+278:#+�=� � ��+ ��?x0 780 )'0 = :�1%���g)�N�0�)'= <>7 :#9��

� "�$ $���N�5*:#+��H+�7��dN/98('0�7 9¡�a1#�dN>+�c'0�7�0�98:#)*O�R�:@)*OF(*:@={9 :���;_)H0�P@E>= :�=�}�78^ [ R�:@)*O (*:�={9 :���~5'+2^ 78:@+�=��V�g) ������h� ��l �V��� � h'� � r �d�� �k��� � ���%� ����� � h�� �k�Q��� �%v*r�i�k��r �k����1I_+2E>P#+�0 )'G�As1'Id^ 5'7 +�7��o��+�G*=�1 ���'|�1HId+2:�G�+2P��'|s^ 7�G�78+���5/9��o"�- � �'�>c*c�1'�F���g� �*1

� "�$*"2��N�^�]60'� �F^ 5')��eAC^ )H��+2c*9 ('0 PTN/9 78('�k98(*78+�=��*;G*G�:�= ^ )��j��+�={P@+2EF�*Id+�0FG�:@)*O'�o"�- �F�*1� "�$F.���N�7 :@)*:@M�0F=2��3J1@� ����� � h�� �k� � � t�i� � � r��%�8v �n � ��yWy\����Wr�!�r�l@i8wey,r2�'� �Hi�i�l

z�i� � �%������� �V��� � h'� � r �k�_�a1 �V+���5T1x9 5'+�= :@=��d|+�c�9�16^�}�A~N��_�C�{�L� ��0�)'c*(*7���X0�E�"�-F-*" 1

� "�$ ����N>980��'P#+�7�� � 7�1@�V��G*]60 78GZYB1#� Y�0�7�={:@)*O�0 =�RT^ OF:@��0�PCAC^ )H=L98780 :#)/9�N�0�98:@={}�0 ��9 :@^ )��:@)�N�0�:@)/9{�g|: �2:@+27_0 )'GuN �2c'0 < ^�]d:����\�L"�- - $/�k��c*cT1e��.��j-F�*1

� "�$�& �4�V+2)')'0�)/9��� s0�787 EF� �����Qh�8��l �T��� � h'� � r �6 i���r� �k��� � �*YB+�987 ^���+�P#P@:'36^>^ <�=��/`+2]�x^F7 <%�o"�- �*"F1

� "�$F���4�V^ [\:#980'����0F= 0 7 (T� ��� ����r2�'� �_�� �k��� � z�i� ������h� ��l �T��� � h'� � r����4P@(/]6+27�;s�20��G*+2[\:@��Y�(*�*P@:@= 5*+�78=��*36^F={9 ^ )T�e"�- �/��1

� "�$ ����P#P@[,0�)�� �F+ � 7 +�EZ|�1@� �6k���e�2� wel#r ��i{z��W���g� � ���2r � � �k�gr�y �k��AC^F[\c*(�9 +�7WN��2:D�+�)'��+�Y�7 +�= =��%"�-F�/�>1

� "�$/���JM�0 ) Id:@+2[,=8G�: KL<%�� +2)*< As1@��0 )'G���G*]d:#) � :#P@P#:�0�[,=��x�g)/9 78^�G�('�k98:#^F)a9 ^�9 5'+�~5'+2^ 78E¡^ }BUJ7�0�[\[,0�7��*���L��Y�7 +�= =��%"�- �F�*1

� "�$ ���J?s: K{0�E/�LN>5'0 )*< +�7��T�\1@� �= :#)*O�|s+�=8��78:@c�9 :@^ )'=�^�}_�T78+2+�=4:#)�0��V78+2+¡;G�KL^ :@)*:#)'OUJ7�0�[\[,0�7�� ��i�y_w%h��j���Q��i��e��l �B��� � h�� �k������"��*�/&��Q|+���1o"�- -F.F�k�/c*c�1>&F�'"��L��"��>1

� "�$ -��J?s: K{0�E/�LN>5'0 )*< +�7����\1@�F0 )'G�;780�M>:@)'GW�\1 � ^/={5*:����)*:��e�20�98:#^F),360F={+�G��V78+2+d;G>�KL^F:#)':#)*O UJ7�0�[\[\+27�1��g) �'1���+�G�+2<>:@)'G ��+�G*=21 �k� � �'� �C�����Q��i��'� �s���2r�� � ��yW�y,�� �k�'��1 �k1 �41'Yx78+�=8=��*A60 [��*78:�G�O +F�*��;���"�- -'"���98^¡0�c*ce+�0 7���1

� " "�$��J��0 = ^�]���41@�4ns�%�8w*v'i� � ��� � r2�er2 ����� !�r � 8��yWy\��k�s�_1_N/98^ 78E/�gN��2:#+�)/9 :��20YB1 ?�1 3J1 ;�1HN��2:#+�)F98:��e��Yx(*�*P@:�={5*+�78=���367 ('=8= +2P�=2�o"�-/��-'1

� " " "2�J�Z+25'7 P@:Q����7 :����>Y�0�7�={:@)*O�]d:#9 5uU43C�gUJ7�0�[\[,0�7�� �g) ������h� ��l �V��� � h'� � r �d�� �k���� � ���e� �B��� � h�� �k����� �%v*r�i�k��r�k����1�I_+2E>P#+60�)'G\As1�I_^ 5*78+27�����+�G'=21 �k��|�1�Id+2:�G�+2PY�(*�*P@:@= 5*:@)*OfAC^'1@�'|s^ 7�G�7 +���5/9��%"�-F� �*�>c*cT1�"��F���L.�$*"F1

� " "�.��J� :@+�G*+2785*^ P�Go�HUJ:@^'�'�W���g� � ���2rJ��r �k� � �H�'����UJ780�]~�g _:@P#P��*`_+�]��x^F7 <%�o"�- �F.*1� " "����J� :@)*^FO 7�0 Go���V+2787 EF�� �e�Fr� �k�g���e����� � ������h� ��l �V��� � h'� � r2�';s�20 G*+2[\:@�4Y�7 +�= =��

`+2]¢�x^ 78<%�o"�-/� .�1

Page 216: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�$ & �������������� ���� �

� " "2& �J� :@)*^FO 7�0 Go� �T+�7 78E � �V��� � h'� � ru���¡� �xi � �'����� !�r �~ i���r � � � �Hi�l � ! � � �H�j� �F�;sG*G�:�={^F)��j��+�={P@+2EF�*Id+�0FG�:#)'O'�'��;���"�-F� �'1

� " "����J� :@7 9 5��/`_:@</P�0�(H=2��nsl � i�k����v�y ��� �W���g� �e�Qkh'�2��h� r��� �6 i � ��y �k�/Yx78+2)/9 :���+2� s0�P@PQ�H�x)*OFP#+�]C^>^�G�ACP@: � =��'`_+�] �F+27�={+�E �%"�->���'1

� " "����J� :@P@+2)'= <>E �uId^ �e+27 9�� �6l#���H�'��� � ���e� � �e�Fr� �k�g���e����� � ��;sG*G�:�={^F)����Z+�= P@+2E �I_+�0 G*:#)*OH�*��;��T"�- �F�*1

� " "����J�Z^>^�G*=2� � :@P#P@:@0 [ ;�1#��RT(*)'0�7�Id^���<>=4:@)�`0�9 (*7�0�PC�x)*OFP#:�={5T!�� ��c*P@^ 7�0�98:#^F)'=:@)u`0�98(*7�0�P%RT0�)'O ('0 O +��s('+�={9 :@^ )f;)'={]6+278:@)*O'�>�g)�;�1 �%0�[\ce^ P@P#:���+�Go1 �k� �����'�� h�� �k�Q��� �H��kh'�2�Qh� r � �~ i���r � ����� � �H�xP�={+�M/:@+27_`^ 7 9 5��g _^FP#P�0�)HGo�%"�-/�F�>1

� " "����s�x^F(*)*OF+27��e|�1  �1#��I_+���^FO )*:#9 :@^ )�0 )'G�Y�0 78= :#)'O,^�}6AC^ )/98+��>9JS'7 +�+�RT0 )*O (H0�O +�=:@)��~:#[\+���� � � ��z�i�ky,������i��Z���e� �xi��'�� i�l�! � ��"�-F�/�>�>c*cT1�"��F-��L.�$ �'1

� " "�-�� �%7 :@�*:#�j +27 9 � �e;_)*)'+ �%;_)'0 c*5*^ 7�0*�e36:#)'G*:#)*O�0�)'G�`s0�78780�9 :@M +�YB^ :@)/9^�}�?:@+2]�!��)*O P@:�={5�Id+ �'+���:#MF+sYx78^ )'^ (*)'=C:@)�N>+�)F98+2)'�2+J0 )'Gf|s:�= �2^ (*7�={+F� �T��� � h'� � r � � �#'��"�-F� -'�/c'c�1'� -/���{��./�>1

Page 217: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� � ���

� $��g. $�78(*P@+ �H./�>�%" "�$

0 0 <�0 0�)'<>= 5'0F0*��. ���*�F-0��'�*7 +�M>:@0�9 :@^ )'=C}�^ 7d<�0 780 <�0F=2��-'"0��'P@0�9 :@M + �*�/�0 ����('=80�98:#MF+ ���F�0 ��9 :@M +2��c'0F= = :@M + �e"�. $*�%"��F�0 ��9 :@M +2��c'0F= = :@M +�=��>� -0 ��9 :@M +�=2�o"��F�0 ��9 :@M>:D9LEF�o"����*�F$0 G*5*:#<�0 780 )'0*����&0 G�KL+��k98:#MF+��j)*^ (')��o"��0 G�KL^ :@)*:#)'OW^FcH+�780�9 :@^ )��o"�&>�0 G�KL(*)'�k9���"�� .0 G�KL(*)'�k98:#^F)���"�&F�*�%"�� �0 G�KL(*)'�k9�=2�T" "�-0�OF+2)/9��o"��*�*�F�0�OF7 +�+2[\+2)/9���� $*�*�'" �o"�./�>�%"��F.0�OF7 +�+2[\+2)/9��/78+2P�0��o�o"F"�.0�<�0 )*<�={5'0���EF^ OFEF0�9�0*�*"�.��;RVYo;A 78+2ce^ 7 9��o"�$�&0�)H0�P@E ��+27�����&0�)H0�c*5*^F780'�%"�� $'�%"�� �0�)H��5*^ 7�=2�%"���&0�)':#[,0 �2E¡c*78+�}�+�7 +�)'��+F�*-/�0�)/98+���+�G�+2)/9dO ^�MF+278)*[\+2)/9��%"���&0�)>('=80�7�0�<�0'�H"�$ �0�cH0 G*0 )��*��&0�c'c*P#:��20�9 :@^ )'=��*`RVYB�o"0�78O ('[W+�)/98=6^�}BM +�7 ���o"��0�78O ('[W+�)/98=��/[,0 )'G*0�98^ 78E �o"�� �0�78O ('[W+�)/98=��/^Fc�9 :@^ )H0�P��o"�� �0�78O ('[W+�)/98=��>= +2)/98+2)/9 :�0�P��o"��>�0 = 5*7�0�EF0'�/�F�

;= 5/980FG�5>EF0�E>:Q�%"��F�0 =8= :#OF)*[\+2)/9��*-F�*�*- �0�9 9 78:#�'(�9 +�OF780 [W[,0 78=��H"��*"0�( �>:@P@:@0 7 E\987 +�+ ��"�&F�

�'0F��</OF7 ^F(*)'Gf</)'^�]dP#+�G�O +F�>��'0 7 78:#+�7��%"����365'0�7 9 7�0�5H0�78:Q�'�>"F��� $�*:@)'0�78Ef= +�0 78��5����F-�*:@)'G�:@)*O'�T"���&�*:@)'G�:@)*O,c*78:#)':#c*P@+ �T"���&�*:@)'G�:@)*O\9 5'+2^ 78E �o"�� ��*:@c'0�7 9 :#9 +�OF780 c*5f[,0�98��5*:@)*O'�*-F�

�k�g��^F[\[\0 )'G*=��o"�����k�g={9 78('�k98(*7 +F�o"�.*"�20F={+�0F= = :#OF)*[\+2)/9��o"���&�20F={+ �'P#9 +�7��T"���&�20F={+�=2�o"��F�A6SVUW�'" "�-'�*"�. �*��"��F���'"2&'"F��"�� �*��"�� .AC5*^F[\= <>E¡5*:@+27�0�7���5>E �>&��P@^F= +2)'+�=8=~c*7 +2}�+278+2)'�2+ ��-/���^ ��^�����(*787 +�)'��+J78+�={9 78:@��9 :@^ )'=��%"�.����^F5*+278+2)H��+ �o"�.��'�e"��*"��^F:#)HG�+���:@)*O'�o"�.F���^F[\[�(*)*:��20�9 :@^ )��H���'��-'�o"���-Ad�J��YB�o"���.��^F[\c*:#P�0�98:#^F)���&/.��^F[\c*:#P�0�98:#^F)���:@)'��78+2[\+2)/9�0�P���&>���^F[\c*PQ�T"���.��^F[\c*P#+29 +�Gf987 +�+ �o"�&F���^F[\c*P#+29 +�Gf987 +�+4:#)��_N*UW��"�&F$��^F[\c*P#+29 +�)*+�=8=2�o"�.��'�o"��*"��^F[\c*P#+���= E/[��H^FP@=��o"�. ���^F[\c*P#+����20�9 +�O ^ 78:@+�=��e"�.��

.�$F�

Page 218: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�$F� ���������

��^F[\c*P#+���= +2)/9 +�)'��+�=2�H��$��^F[\cH^/={:#9 :@^ )'0 PQ�o"����^F[\cH^F(*)'G�]C^F78G��>�F���^F[\c*(�980�9 :@^ )'0 PoO 7�0�[\[,0�7��*.����^F[\c*(�980�9 :@^ )'0 PoP#:@)*OF(*:@={9 :��2=��'���^F)�KL^ :@)*+�Gf]6^ 7�Go�*� ���^F)'={9 :#9 (*+�)F9={9 78('��9 (*78+ �o"�.�$*�%"�.�"��^F)'={9 :#9 (*+�)F9�=2�T"2&��^F)'={9 7�0�:@)F9~O 7�0�c'5��*� �'�*� -��^F)'={9 7�0�:@)F9d=80�9 :�={}�0 �k98:#^F)��o"��F���^F)'={9 7�0�:@)F9�=2���F-��^F)'={9 7�0�:@)F9�=6^ )�[W^�MF+2[\+2)/9��o"������^F)/9 +��>9~}�78+2+�O 7�0�[\[,0�7��e" "�-��^F)/9 +��>9~}�78+2+�O 7�0�[\[,0�7��e"�� -AC^ )/98+��>9N>+2)'= :#9 :@M +�UJ7�0�[\[,0�7��e"���-��^F)/9 78^ P��*��$*�o"�� ���^F)/9 78^ P@P#+�+ �%"�./���^F)/9 78^ P@P#+�7��%"�./���^F7 +Jc'0 78= +27��'. �*�>�>���^/=L9~}�(*)H�k9 :@^ )T�'-*"

|�j={9 78('�k98(*78+ �o"���$*�%"��'"G*0�980��H0 = +J= E�=L98+2[,=2�e�G*0�9 :@M + �o"�.�$'�e"�.��G�+2}�0�(*P#9T<�0�7�0�<�0~��5'0�7 9���={+�+�(*)'G�+�7�<�0�7�0�<�0

��5H0�7 9��*�/�G�+2}�0�(*P#9{�j+��*��+�c�9 :@^ )T�'���G�+�P#:@[\:D98+27�=2��"��G�+�[\0 )'Go�H.F�G�+�[\0 )'G�O 78^ (*cH=2��� �G�+�[\0 )'G*=��*� -G�+�cH+�)'G�+2)H��EfOF780 [\[\0 78=��>- $G�+�7 :@M�0�9 :@^ )T�o"�� �G�+�7 :@M�0�9 :@^ )�9 78+2+F�o"2&F&'�o"2&>�G�+�7 :@M�0�9 :@^ )�9 78+2+�=2�o"�� �G�+�7 :@M +�G¡987 +�+ �o"2&H" �%"2&/�G�+�7 :@M +�G¡987 +�+J:@)��_N*UW��"�&F$G�:��k98:#^F)'0�78E¡^�} 7 ^>^ 98=��*� �G�:@7 +��k9_�20F={+F�*� �G�:�= �27 :@[\:#)H0�9 :@^ )�)*+298=��'- �G�^�]d)��g0�7878^�]��H"�.��G�(*c'P#:��20�9 :@^ )��H��&

�6A6YB�o"���&H�e"�� �

+2[\c�9LE��20�9 +2OF^ 78E �%"��F�+2[\c�9LE��20�9 +2OF^ 78E,c*78:#)'�2:#c'P#+F�o"���&+2[\c�9LE�+2P@+2[\+2)/9���"�./�+278OF0�9 :@M +F�>�/��x('7 ^ 9 7�0*�%"�$/�+2MF^ P@(�9 :@^ )H0�78E¡={E�={9 +2[u�o"F"��+���:�=L98+2)/9 :�0�P��2^ )'={9 7�0�:@)/98=��o"��'"+���c*78+�=8=��o"��/���%"�� �+��>98+2)'= :#�':#P@:D9LEF�H.F�

}��g=L987 ('��9 (*78+ �o"�.�"}�+�0�9 (*78+ �H�F�}�+�0�9 (*78+�={9 78('�k98(*7 +�=2�%"�� .}�+�0�9 (*78+�={9 78('�k98(*7 +�=2�>�e^�9 9 ^ [u��"�� �}�+�0�9 (*78+�={9 78('�k98(*7 +�=2�/98^ c���"�� �}�+�0�9 (*78+�=��o"�./�SVU4 _�j�X�4��"�$>�}�78+2+�]6^ 7�G¡^ 7�G�+�7����/�}�78+2+�]6^ 7�G¡^ 7�G�+�7��*��-'�*��&H�o"��*"}�78+2+�]6^ 7�G>��^F78G*+27��'"��/���o"�� �}�(*)'��9 :@^ )'0 PT= cH+���: �H�20�9 :@^ )��o"�.��}�(*)'��9 :@^ )'0 PT={9 78('�k98(*7 +F�o"�.*"

OF0 78G*+2)��jc'0�985�= +2)/9 +�)'��+�=2�*->�U43J��"��F-*�%"���-O +�)*+27�0�98:#MF+s+�)/9 +278c*78:@= + ��&H�'��-'�o"���-O ^�MF+278)*:@)*O���0�9 +�O ^F7 EF�e"����O ^�MF+278)*:@)*O��g�20�9 +2OF^ 78E �*"�� �O ^�MF+278)*[\+2)/9��%"����UJ^�M +�7 )'[W+�)/9d0 )'G�3C:@)'G�:@)*OH��"��F-O ^�MF+278)'=��e"����U4YCN'UW��"�. �O 7�0 �2+�}�(*P�G*+2O 7�0 G'0�9 :@^ )T��. �O 7�0�[\[,0�7\��^F[\cH^F)*+2)/9��6={(':D9�0��*:@P#:#9LE �

. �O 7�0�[\[,0�76}�^F7 [,0�P@:�={[,=��'�O 7�0�[\[,0�7��>P#+���:@��0�P@:���+�Go�o"�� -O 7�0�[\[,0�98:@��0�P@:D9LEF��-*�o"���-UJ78+2:@�'0 ��5u`_^F7 [,0�P�S'^ 78[u�o"����

5*+�0 Go��"���.5*:�=L98^ 78E¡^�}����4�o"�$ � Y6N*UW��"��F.

Page 219: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� � � � .�$>�

5>(*[,0�)�0�:�G�+�Gs[,0F��5*:#)'+B9 7�0�)'= P@0�9 :@^ )��"�$ �

�L|�jRVY OF780 [\[\0 78=��%"��F�:@)'��78+2[\+2)/9�0�P���^F[\c*:#P�0�98:#^F)���&>�:@)'G�+���+�=2��&/��g)'G�:�0�)�98780FG�:D98:#^F)'0�P%P@:#)'O (*:�=L98:@��=2�e�:@)�}�+278+2)'�2+ �*&:@) � ��"���.:@) � +���9 :@^ )'0 P#P@E¡78:@��5T�'��-:@)�}�^ 78[,0�9 :@^ )��'0F={+�G�0 c*c*78^F0 ��5T�*�:@)�}�^ 78[,0�9 :@^ )�9 5'+2^ 78+�98:@� �*�F�:@)*:D98:@0 Po9 78+2+�=2�o"�&F$:@)F98+2OF+27dc*78^ OF780 [W[\:@)*O'�>-*":@)F98+278P#:@)*OF('0*�o"�$F���%"F"��:@)F98+278[\+�G�:�0�98+JMF+278���H�>":@)F98+278M +�)*+�=��%"����:@)/MF+27�={+Jc*78^ �*P@+2[u�*�F-

�/0�c'0 )*+�= +J`s0�98:#^F)'0�P�Y�7 ^ KL+��k9��%"�$F�KL^��g��^F)'={9 78('�k98:#^F)��%" "2&

<�0�7�0�<�0*���F�*�F"�� $*�/"��'" �F"�� �'�F"��F�*� "��>�<�0�7�0�<�0W��5'0�7 9��*�>�>�o"��F�<�0�7�0�<�0W��5'0�7 9~9 7�0�)'={}�^ 78[,0�9 :@^ )T�>�>�<�0�7�0�<�0�P#+�M +2P��*� �<�0�7�0�<�0�7 +�P@0�9 :@^ )'=��o"��'��� -*�*�>�<�0�7�0�<�0W={5'0 7 :@)*OH�*� �<�0�7�0�<�0 =��%"��/�<�0�7�0�)'0'����&<�0�78[,0*�*� �'���/�>�o"�� �<�0�78[,0��j<�0 7{987��e" "�.<�0�7 980'�o"��*�*�'" ��� �'�*�/���o"��/���%"�� ���0�(')'G��*5'0�9{9�0*�*�*"<>:T��^F)'={9 78('�k98:#^F)��%" "��<>)*^�]dP@+�G�OF+s78+2c*78+�= +2)/9�0�9 :@^ )T�/&<>7 :@EF0�78(*c'0\��5'0�7 98=��'��$

P�0�<�={5H0�)u��5'0�7 98=����/�>�*-F�P�0�)*OF('0�OF+s�'0 7 78:@+27��e"�$ �P�0�)*OF('0�OF+s�*78:�G�O +J}�^ 7BKL^H��" "�&P�0�)*OF('0�OF+s�*78:�G�O +J}�^ 7d<>:���" "��P�0�)*OF('0�OF+s�*78:�G�O +J}�^ 7d)'+ ��"F"��P�0�)*OF('0�OF+s�*78:�G�O +�=2�o"F"��

P�0�)*OF('0�OF+s<>)*^�]dP@+�G�OF+ �*�P�0�)*OF('0�OF+s(*)':#MF+27�= 0 P@=��%"�$P�0�9{98:@�2+ ��"�� $P@+�0 ={9d(*c*ce+27_�e^ (')'Go��"�� $P@+�}�9 )'+�=8=dc*78+�}�+278+2)H��+ �*->�R�+���:@��0�P>S*(*)'��9 :@^ )'0 P*UJ780 [W[,0 7��>" "�-P@+���:@��0�P@:@= +�G�� ;_UW��"2&/�P@+���:@��0�P@:���0�98:#^F)��o"��F-P@+���:@�2^ )�}�^ 7_RVSVUW��"�. �RTSV�j7 +�c*78+�= +2)/980�9 :@^ )��%"���$*�%"��'"RTS UW��" "�-*�%"��/���%"��F-P@:#)*OF(*:�=L98:@��0 7 +�0*�%" "F"P@^>��0�Po]6^ 7�GfOF7 ^F(*ce+27���� $P@^>��0�P@:D9LEF�o"��F-*�o"2&H"P@^ O :��Jc*78^ O 7�0�[\[\:@)*O'�>&P@^ )*O,G�:�=L9�0�)'�2+4[W^�MF+2[\+2)/9��o"�.��P@^ )*O,G�:�=L9�0�)'�2+�G�+2ce+2)'G*+2)'�2:#+�=2��"�� �P@^ )*O_G�:�={980�)H��+xG�+�cH+�)'G�+2)H��E �>"�� .��F"��>�RF� UW�H.�&

[W�j�2^ [\[,0�)'G'=2�o"����[,0 ��5*:@)*+J9 7�0�)H={P�0�98:#^F)��o"�$'"[,0�)'G'0�9 ^F7 Ef<�0 780 <�0*��� -[,0�9���5*:#)'O'�*-�&[,0���:@[\0 Poc*78^�KL+���9 :@^ )'=��o"�� .[,0���:@[\0 Po[,0�98��5':#)*OH�*-F�[,0���:@[\0 Poc*78^�KL+���9 :@^ )��o"����[\+�0 )*:#)'O'�o"��'�o"�. �[\+�0 )*:#)'OWP@+2MF+2P��'� �'�%"�� $[\+�0F={(*78:@)*OW9 ^>^ P��o" "��[\+278:D9��H. �[\+�9�0��jM�0 7 :�0��'P#+�=2�%"�. �[\+�9�0��jM�0 7 :�0��'P#+�=2�>�e^ (*)'G*+�Go��"�.��[\^�G�:��e�20�98:#^F)�� P@:@)*O (*:�={9 :��69 5*+�^ 78E �'"��[\^�G�:��H+27 ��[\^�G�: �'+�Gu={9 78('�k98(*7 +F�o"2&[\^�G�:��H+27 ��[\^�G�: �'+�G�9 78+2+F�H�>"[\^�G�:��H+27 ��[\^�G�: �'+�G�9 78+2+�=2�o"�� �[\^�G�(*P�0�78:D9LEF�'.F�[\^ 78c*5*+�[W+�=2�*�F�[\^ 78c*5*^FP#^FO :��20�Po0 )'0�P@E �2+27��*. .*�>� &[\^ 78c*5*^FP#^FO :��20�P�0 )'0�P@E �2+�7��'9 7�0 G�+�^ � =

:@)��*&/�[\^ 78c*5*^FP#^FO :��20�P%OF+2)*+�780�9 ^ 7��>��&

Page 220: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�$F� ���������

���4�H.*�o"�$'"���4�'S U4 d�g���4��"�$/�

)'0�9 (*7�0�PoP�0�)*OF('0�OF+s:@)/9 +�7{}�0F��+ �o"F"��)'0�9 (*7�0�PoP�0�)*OF('0�OF+sc'7 ^���+�= = :@)*O'�*�)*+��2^ )'={9 78('�k98:#^F)��o" "��`sU4=���"��F�`R���"`RVYB�o")*^F[W:@)'0 PQ�o"��)*^F[W:@)'0�9 :@M + �*�/�)*^F)��Q98+278[\:#)'0 PQ�o"�.��`_^F(*)uO 78^ (*cH=2�*���)*^F(*)uO 78^ (*c'=��>&F-'�o"��F�)*^F(*)uP@0 <>= 5'0 )���5'0 7{9�=2�*-F�)*^F(*)��jM +278�f[\^�G�: �H�20�9 :@^ )��T"��`Yx�Q98780F��+F�e"�� �

^ �*KL+��k9��o" "�-*�o"��/.^ �'P#: �/(*+ �*�F�^ �'P#: �/(*+��20 = + �'� �^ c*9 :@^ )'0 P�0�78O (*[\+2)/9�=2�%"��F�

Y�0�)':#)*:��*� $'�o"��/�Y�0�)':#)*:�0�)�O 7�0�[\[,0�7����/�Y�0�)':#)*:�0�)�0�c*c'7 ^/0 ��5��*��-Y�0�)':#)*:�0�)�O 7�0�[\[,0�7��%"�� �c'0 780FG�:#OF[u�>�F�c'0 780FG�:#OF[ 980 �*P#+F�'�/�c'0 78=80�78O'��.�&H�'��$*�*�/�c'0 78=80�78OF=��>� �c'0 78= :#)'OW0 P#OF^ 78:D985*[u��&c'0 7{98:@�2:#c'0 )/9��o"��c'0 7{98:@�2:#c'0 )/98=��*� $c'0F= = :#MF+�=��%"�� ���%"��F�Y�SV�j7 +�c*78+�= +2)/980�9 :@^ )��e"���$*�o"��'"YCUW�o"�� �'�o"���-c*5'0 P@0'�*� $ce^F={9{�j+�G�:#9���"�$ �ce^F={9{�jcH^/={:#9 :@^ )��'.�&'�*�/�ce^F={9{�jcH^/={:#9 :@^ )'=��'��-Y�YB�o"�.��c*7�0�OF[\0�9 :��2=����c*7�0�E ^FO'�e"�� �

c*78+�G�:��20�9 +�0�78O ('[W+�)/9��o"�.*"c*78+�G�:��20�9 +�0�78O ('[W+�)/98=��o"2&'"c*78+�}�+�7 +�)'��+���^F)'={9 7�0�:@)F9�=2��->�c*78+2ce^F= :D98:#^F)'0�Poc'5*780F={+F�%"�.��c*78:#)H��:@c*P#+�=_0�)HGfc'0 780 [\+�9 +�78=��%"���"c*78^�KL+��k9 :@^ )�c*78:#)H��:@c*P#+F�o"�� .Yx78^ P@^ OH�%"�� $c*78^ ce+27dOF^�M +278)*[\+2)/9��e"���&c*78^ ce+278P#EfO ^�M +�7 )H=2�e"���&c'= E���5*^ P@:#)'O (*:�=L98:@��=2�o"F"

�/('0�)/98:��'+�78=��o"��F��/('0 = :#�Q987 +�+�=��e"�� �'�o"�� �

78+�G�(*c'P#:��20�9 :@^ )��'��&78+2P�0�9 :@M +��2P@0 ('={+F�o"��F�78+2P�0�9 :@M>:���0�98:#^F)��o"2&/�78+�= (*PD9��'� $78+2M +�78= +4={( � �¡9�0��*P@+ �'&/.78+2]d78:D98:#)*OH�o"��F-

N/�g=L987 (H�k9 ('7 +F�o"���$'�%"��*"=80�<�0�78[,0�<�0*��� �=80�[,0 0 )*:@G*5'0�<�0�7�0�)H0*�e"��=80�[\c*7�0 G*0 )'0*����&=80�)'G�5':T0�)'0 P#E ��+27��>� &=80�)*)*:�G�5*:��H.F�N�0 )'={<>78:D9��*�/���o"��F�= +�0�7���5���� -= +2[,0�)/9 :����o"��/�= +2[,0�)/9 :��s9LE>cH+�5*:@+27�0�7���5>E ��-/�= +2[,0�)/9 :���^ �j= E>)/980 ��9 :������F.= +2[,0�)/9 :��2=��*�= +2[,0�)/9 :��2=~:@)�=L9�0�OF+�=����F�= +2)'= +�=��*- �= +2)'= +�=~^ } ]6^ 7�G*=��>�>�= +2)/9 +�)F98:@0 P�0�78O (*[\+�)F9�=2�o"�� �= 5'0�78+�G�<�0�7�0�<�0 =��'��$*�H��"= :#[\c*P@+�]C^F78G��*� �= ^ P@(�9 :@^ )�O 7�0�c*5T�*� -= ^ 7 9 +�G�78+2M +�78= +4={( � �¡9�0��*P@+ �'&F�= ^ (*7���+4O 78^ ('c'=2���F�= cH+�����"���.= cH+�P#P@:#)'O¡= ��5*+�[\+ �o"��/�

Page 221: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� � � � .�$F-

={980�98+ �o"��={980�98:@={9 :��20 P�0�c*c'7 ^/0 ��5*+�=2���={980�98:#MF+�=��o"��/�={9 7�0�9 +�O E\}�^F7_���4��" "��={9 78('�k98(*7 +F�o"2&= (*���g0 �k98:#^F)'=��*� $= (*���g�20�98+2OF^ 78:���0�9 :@^ )T�H"�.��= (*�e��0�98+2O ^F7 : ��0�9 :@^ )��%"�� �= (*��K{0 �2+2)'�2E �o"���&N �s3��/�6A6�4�o"����= (*��KL+���9���"F"�-'�e"�� �'�e"��F.N>(*�*KL+��k9 �Q98^��g={('��KL+���9~7�0�:�= :#)*OH�o"����= (*�'={9 :#9 (�98:#^F)���"��F-*�%"��/�= (*�'={9 :#9 (�98:#^F)�)'^>G*+�=���"2&/$= (*�'={9 :#9 (�98:#^F)�^FcH+�780�9 :@^ )��o"�&'"= (*�'={9 :#9 (�98:#^F)�^FcH+�780�9 :@^ )��o"�&F$= (*�'= (*[\c�9 :@^ )��T"�� $= (*7{}�0F��+��20F={+F�*�F�= (*7{}�0F��+4P@+2M +�PQ�*�/.= (�9 7�0*�o"��/�= ]60�980�)/98780'�>�'" ��� �= E/)/9�0 �k98:@�J5*^FP#+F�o" "�&= E/)/9�0 �k98:@�2^��g={+�[,0�)/9 :������F.= E>={9 +�[m}�+2+�G��'0F��<e�'. �= E>={9 +�[,=d0 = cH+��k9��e.��= E>={9 +�[,=d0 = cH+��k9��'P@0 7 OF+ �*.F�

980FG*0�7 9 5>E/0*����&� ;_UW��"2&/�*�%"��F.��%"��F�� ;_U c'0 78= +27��%"��>�� ;�a�'�/.� ;� P@0 �H+�PQ�e��"� ;� P@0 �H+�PQ�H�F.��*�>�� ;� P@0 �H+�PQ�'�'0 = :@� �*�/�980F={<�G�^ [,0�:@)'=��o"�$F�� ;���u�g�����d�~���%"�$�&�_UW��"�� -9 5'+2[,0�98:@�478^ P@+�=��%"��9 5'+�980,�27 :#9 +�7 :@^ )T�e"���.9 5'+�980\78+2P�0�98:#^F)'= 5*:#cH=2���F�9 5'+�980\78^ P@+ �o"��F�*�e"���.9 5'+�980\78^ P@+�=��%"��9 5'+�980��j�27 :#9 +�7 :@^ )T�e"�.��

9 5'+�980���78^ P@+�=��o" "�-9 ^Fc*:��20�P@: ��0�98:#^F)��o"��/.9 7�0 �2+ �o"���&'�%"����*�o"�� �9 7�0�)H=L}�+�7_0�c*c*78^F0F��5��%"�$/�9 7�0�)H=L}�^F7 [,0�98:#^F)����/�9 7�0�)H=L}�^F7 [,0�98:#^F)'0�P%OF780 [W[,0 7��e"��F-9 7�0�)H={:#9 :@M +F�*� �9 78+2+F�*&/�9 78+2+�0FG*G�78+�=8=2�%"�&'"�V7 +�+�N�(*�'={9 :#9 (�98:#^F)XUJ780 [W[,0 7��%"2&/$9 78:@+ �*&>��_N*UW��"�&F$9LE>cH+�5':#+�780 78��5>E ��->�

(*)*: �H��0�9 :@^ )T��"�. $*�%"�. �*�%"���&(*)*: �/(*+2)'+�=8=2��"�. �(*)*:#9��V"2&(*)*:@M +�78=80�PoOF780 [\[\0 7s�T"���-(*)*:@M +�78=80�PoOF780 [\[\0 7�����-(*c��g0�7878^�]��e"�.��(�9�= 0 7 O/0��g0�c'0�M�0 0FG*0*�>���(�9�= 0 7 O/0��g0�c>M�0 G*0'�>� �

M�0�78:@0 �*P@+�=��o"����M +�7 ��O 78^ ('c'=2�>&/-M +�7 �u0�78O ('[W+�)/9��o"��M +�7 �u= +2)'= + �*-F�M +�7 �u= + �/(*+2)H��+�=��'��$M +�7 �H0�P��o"��M>:#�'5'0�</9 :��'�/���o"��/���%"��>�M>:#�'5'0�</9 :�}�^ 7dM +�7 �H=2���F.M>:#�'5'0�</9 :TP#+�M +2P��o"��/.M>:#�'5'0�</9 :TP#+�M +2P��*�F.*�*� �M>:@= 5*+�={5'0 )'0*�o"�&M>:@= 5*+�={5>EF0���M>:�={5'+�= 5'0�)'0'�H"�&M>:#M�0 <>= 5'0'�*� $*�*�F�*�%"��F$M ^�]6+2P%5'0 7 [\^F)/EF��&>�M>EF0 c'0�7�0*��� $

]6+2:@O 5/9 +�Gf[,0�9���5*:@)*O\c*7 ^F�*P@+2[u�*- �]6+2P@PD��}�^ 78[\+�G�)*+�= =~�2^ )'G�:#9 :@^ )H=2��"�. �� SB�4�H�>�]d5�� �/(*+�={9 :@^ )��o"�.�"]6^ 7�Go�*� �

Page 222: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�"�$ ���������

]6^ 7�G,}�^ 78[,=2�H� �]6^ 7�G,}�^ 78[,=6980 �*P#+F�'�/�]6^ 7�G¡O 78^ ('c��o"��]6^ 7�G¡O 78^ ('c'=2�'� $]6^ 7�G¡^ 7�G�+�7��'� -

�_�j�'0 7~9 5*+�^ 78E �o"�� .

E ^FO E/0�980F0*��. �*�>�F-

Page 223: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

��� � � � .�"F"

Page 224: cdn.iiit.ac.incdn.iiit.ac.in/cdn/ltrc.iiit.ac.in/downloads/nlpbook/nlp...Tµc¡ E µ ª | µ«¥c¬3 T ) "!$#&%&')(* $+#, - . / . / . / / 0 / . / . / / . / . / 0 / / . / . / . ) FE

.�"�. ���������

����������� ������������������������������� �!"$#%!"'&(�

) *,+-)/.1032547698:2<;>=?2A@/B:2A@DCA2FE-@HGIE-CJ;�B:2A=KB:LM;�B�ENB�E-=�;>0H;9G=?25@OB:25@MCA2QPRTS U @HGIEVCA;�B:2A='6QWIB:XMWIB S E-@HGIEYXI8:6OGDWDCA2JG�0/Z�;9@OWD=:;�8[;9\9;IP] ^ U @HGIEVCA;�B:2A='_Q`-69=?=aE-@ ^ @M_9`VE-=?LYP\9;�8[;�\Q; b/ZI@OB[;�C5B:E-CA69cd=?2Ae�;�@/B:EVCf8:2A`V;�B:E-6Q@g0325Bih�2A2A@j;akl258:0m;�@HG"E-B:=;�8:_QWDe�2A@/B:=AP\9;�8?B[;j\9;�8[;�\Q; n LD2'e�6Q=oBfE-@HGD25X32A@HGI2A@/B6�43B:LM2'\9;�8[;9\9;9='pq8:69WM_QLD`NZ/r/CA698?c

8:25=?X36Q@HGI=sB:6�;9_92A@/BJrM0DWDB'@M6�Bt;9`Nhs;AZI=AP u\9;�8:e�;g\9;�8[;�\Q; n LD2v_Q6Q;9`w;�8:_QWDe�2A@/B'694wB:LD2vkl258:0xP\9;�8[;9@M;j\9;�8[;9\9; n LD2vE-@M=oB?8:WMe�25@OBJP=:;9e�XI8[;QGD;9@H;�c\9;�8[;9\9; n LD2v032A@M2zyHCAEV;�8?Z�6�4{B:LM2v;�C5B:E-6Q@xP;9XM;QGD;9@H;�c|\Q;�8[;9\9; n LD2}yM~I2JGF6�8'8:254q258:25@MCA2"6Q0O�o25C5Ba4�8:6Qe�h'LME-C[LFB:LM2v=?25XH;�c8[;�B:E-6Q@<;�C5B:E-6Q@�B[;9\Q2A='XM`V;9CA29P;QGILME-\9;�8[;9@M;�c\9;�8[;9\9; n E-e�2";�@HG�`-6/CJ;�B:E-6Q@<694{B:LD2v;9CzB:EV69@xP

`V;9\O=?LM;9@DcC[LH;�8?B � EV=?Cz8:EVe�E-@M;�B:E-6Q@�@D25BJP�9��� � 6/CJ;9`Yh 6�8[GF_98:69WMX3258JPXM;�8:=:;�8:_ �w69=oBtX36Q=?ENB:E-6Q@<e�;�8:\Q258JP

� XH;�8:=:;�8:_ �a6Qe�E-@H;�B:E-kl2}e�;�8:\Q258sE-@ S E-@MGDE�P\l6KXM;�8:=:;�8:_ *tCACAWD=:;�B:E-kl2v698aGD;�B:E-kl2}e�;�8:\l258'E-@ S EV@MGDE�P@M2vXM;�8:=:;�8:_ ^ 8:_l;�B:E-kl2"e�;�8:\l258 EV@ S E-@HGIE�P=?2vXH;�8:=:;�8:_ U @M=oB?8:WDe�2A@/B[;9`3698a;�0M`V;�B:E-kl2ve�;�8:\l258'E-@ S E-@MGDE�P\9;Q;jXM;�8:=:;�8:_ � 25@MENB:E-kl2ve�;�8:\l2z8'EV@ S E-@HGIE�P� � �{;�@ME-@MEV;�@ � 8[;9e�e�;�8"pq478[;9e�2zh 698:\DuB[;9GM;�8?B:L/ZO; �1WD8:X369=?2}4q6�8ah'LDEVC[LFB:LD2v;9C5B:E-69@�E-=tCA;�8?8:E-2JG�6QWIBJPnw*T� nx2A@M=?2";�=?X32AC5Bte�6OGM;�`VENB�Z/PkOE-0MLM;9\/B:E ��69`-`V25C5B:E-kl2A`NZ|��CJ;�=?2"2A@HGIEV@D_DrDX36Q=oBtX36Q=?ENB:E-6Q@<6�8tXD8:2AX369=?E-cB:E-69@�6941;g@M6QWD@xrD698anw*T�,`�;�032A`�6�41;jkl2z8:0xP