Apache Hadoop Developer 시험 - Hortonworks실제시험문제와 답 - 108문항

Question No : 1

In the reducer, the MapReduce API provides you with an iterator over Writable values.
What does calling the next () method return?

A.It returns a reference to a different Writable object time.
B.It returns a reference to a Writable object from an object pool.
C.It returns a reference to the same Writable object each time, but populated with different data.
D.It returns a reference to a Writable object. The API leaves unspecified whether this is a reused object or a new object.
E.It returns a reference to the same Writable object if the next value is the same as the previous value, or a new Writable object otherwise.

정답:
Explanation:
Calling Iterator.next() will always return the SAME EXACT instance of IntWritable, with the contents of that instance replaced with the next value.
Reference: manupulating iterator in mapreduce

Question No : 2

In Hadoop 2.0, which one of the following statements is true about a standby NameNode?
The Standby NameNode:

A.Communicates directly with the active NameNode to maintain the state of the active NameNode.
B.Receives the same block reports as the active NameNode.
C.Runs on the same machine and shares the memory of the active NameNode.
D.Processes all client requests and block reports from the appropriate DataNodes.

정답:

Question No : 3

You write MapReduce job to process 100 files in HDFS. Your MapReduce algorithm uses TextInputFormat: the mapper applies a regular expression over input values and emits key-values pairs with the key consisting of the matching text, and the value containing the filename and byte offset. Determine the difference between setting the number of reduces to one and settings the number of reducers to zero.

A.There is no difference in output between the two settings.
B.With zero reducers, no reducer runs and the job throws an exception. With one reducer, instances of matching patterns are stored in a single file on HDF
C.With zero reducers, all instances of matching patterns are gathered together in one file on HDF
D.With one reducer, instances of matching patterns are stored in multiple files on HDF
E.With zero reducers, instances of matching patterns are stored in multiple files on HDF
F.With one reducer, all instances of matching patterns are gathered together in one file on HDF

정답:
Explanation:
* It is legal to set the number of reduce-tasks to zero if no reduction is desired.
In this case the outputs of the map-tasks go directly to the FileSystem, into the output path set by setOutputPath(Path). The framework does not sort the map-outputs before writing them out to the FileSystem.
* Often, you may want to process input data using a map function only. To do this, simply set mapreduce.job.reduces to zero. The MapReduce framework will not create any reducer tasks. Rather, the outputs of the mapper tasks will be the final output of the job.
Note:
Reduce
In this phase the reduce(WritableComparable, Iterator, OutputCollector, Reporter) method is called for each <key, (list of values)> pair in the grouped inputs.
The output of the reduce task is typically written to the FileSystem via OutputCollector.collect(WritableComparable, Writable).
Applications can use the Reporter to report progress, set application-level status messages and update Counters, or just indicate that they are alive.
The output of the Reducer is not sorted.

Question No : 4

For each input key-value pair, mappers can emit:

A.As many intermediate key-value pairs as designed. There are no restrictions on the types of those key-value pairs (i.e., they can be heterogeneous).
B.As many intermediate key-value pairs as designed, but they cannot be of the same type as the input key-value pair.
C.One intermediate key-value pair, of a different type.
D.One intermediate key-value pair, but of the same type.
E.As many intermediate key-value pairs as designed, as long as all the keys have the same types and all the values have the same type.

정답:
Explanation:
Mapper maps input key/value pairs to a set of intermediate key/value pairs.
Maps are the individual tasks that transform input records into intermediate records. The transformed intermediate records do not need to be of the same type as the input records. A given input pair may map to zero or many output pairs.
Reference: Hadoop Map-Reduce Tutorial

Question No : 5

Which describes how a client reads a file from HDFS?

A.The client queries the NameNode for the block location(s). The NameNode returns the block location(s) to the client. The client reads the data directory off the DataNode(s).
B.The client queries all DataNodes in parallel. The DataNode that contains the requested data responds directly to the client. The client reads the data directly off the DataNode.
C.The client contacts the NameNode for the block location(s). The NameNode then queries the DataNodes for block locations. The DataNodes respond to the NameNode, and the NameNode redirects the client to the DataNode that holds the requested data block(s). The client then reads the data directly off the DataNode.
D.The client contacts the NameNode for the block location(s). The NameNode contacts the DataNode that holds the requested data block. Data is transferred from the DataNode to the NameNode, and then from the NameNode to the client.

정답:
Explanation:
Reference: 24 Interview Questions & Answers for Hadoop MapReduce developers, How the Client communicates with HDFS?

Question No : 6

In a MapReduce job, the reducer receives all values associated with same key.
Which statement best describes the ordering of these values?

A.The values are in sorted order.
B.The values are arbitrarily ordered, and the ordering may vary from run to run of the same MapReduce job.
C.The values are arbitrary ordered, but multiple runs of the same MapReduce job will always have the same ordering.
D.Since the values come from mapper outputs, the reducers will receive contiguous sections of sorted values.

정답:
Explanation:
Note:
* Input to the Reducer is the sorted output of the mappers.
* The framework calls the application's Reduce function once for each unique key in the sorted order.
* Example:
For the given sample input the first map emits:
< Hello, 1>
< World, 1>
< Bye, 1>
< World, 1>
The second map emits:
< Hello, 1>
< Hadoop, 1>
< Goodbye, 1>
< Hadoop, 1>

Question No : 7

Given the following Hive commands:

Which one of the following statements Is true?

A.The file mydata.txt is copied to a subfolder of /apps/hive/warehouse
B.The file mydata.txt is moved to a subfolder of /apps/hive/warehouse
C.The file mydata.txt is copied into Hive's underlying relational database 0.
D.The file mydata.txt does not move from Its current location in HDFS

정답:

Question No : 8

Consider the following two relations, A and B.

A.C = DOIN B BY a1, A by b2;
B.C = JOIN A by al, B by b2;
C.C = JOIN A a1, B b2;
D.C = JOIN A SO, B $1;

정답:

Question No : 9

Given the following Pig command:
logevents = LOAD 'input/my.log' AS (date:chararray, levehstring, code:int, message:string);
Which one of the following statements is true?

A.The logevents relation represents the data from the my.log file, using a comma as the parsing delimiter
B.The logevents relation represents the data from the my.log file, using a tab as the parsing delimiter
C.The first field of logevents must be a properly-formatted date string or table return an error
D.The statement is not a valid Pig command

정답:

Question No : 10

Which one of the following Hive commands uses an HCatalog table named x?

A.SELECT * FROM x;
B.SELECT x.-FROM org.apache.hcatalog.hive.HCatLoader('x');
C.SELECT * FROM org.apache.hcatalog.hive.HCatLoader('x');
D.Hive commands cannot reference an HCatalog table

정답:

Question No : 11

You are developing a combiner that takes as input Text keys, IntWritable values, and emits Text keys, IntWritable values.
Which interface should your class implement?

A.Combiner <Text, IntWritable, Text, IntWritable>
B.Mapper <Text, IntWritable, Text, IntWritable>
C.Reducer <Text, Text, IntWritable, IntWritable>
D.Reducer <Text, IntWritable, Text, IntWritable>
E.Combiner <Text, Text, IntWritable, IntWritable>

정답:

Question No : 12

Which one of the following statements regarding the components of YARN is FALSE?

A.A Container executes a specific task as assigned by the ApplicationMaster
B.The ResourceManager is responsible for scheduling and allocating resources
C.A client application submits a YARW job to the ResourceManager
D.The ResourceManager monitors and restarts any failed Containers

정답:

Question No : 13

You need to create a job that does frequency analysis on input data. You will do this by writing a Mapper that uses TextInputFormat and splits each value (a line of text from an input file) into individual characters. For each one of these characters, you will emit the character as a key and an InputWritable as the value.
As this will produce proportionally more intermediate data than input data, which two resources should you expect to be bottlenecks?

A.Processor and network I/O
B.Disk I/O and network I/O
C.Processor and RAM
D.Processor and disk I/O

정답:

Question No : 14

What types of algorithms are difficult to express in MapReduce v1 (MRv1)?

A.Algorithms that require applying the same mathematical function to large numbers of individual binary records.
B.Relational operations on large amounts of structured and semi-structured data.
C.Algorithms that require global, sharing states.
D.Large-scale graph algorithms that require one-step link traversal.
E.Text analysis algorithms on large collections of unstructured text (e.g, Web crawls).

정답:
Explanation:
See 3) below.
Limitations of Mapreduce C where not to use Mapreduce
While very powerful and applicable to a wide variety of problems, MapReduce is not the answer to every problem. Here are some problems I found where MapReudce is not suited and some papers that address the limitations of MapReuce.

Question No : 15

What does Pig provide to the overall Hadoop solution?

A.Legacy language Integration with MapReduce framework
B.Simple scripting language for writing MapReduce programs
C.Database table and storage management services
D.C++ interface to MapReduce and data warehouse infrastructure

정답:

Hortonworks Apache Hadoop Developer 시험